2020-04-02T23:14:08.374 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-02T23:14:08.374 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.WcQW_P.tmp -- --verbose --lock --description fs/verify/{begin.yaml centos_latest.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} --name gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148 2020-04-02T23:14:08.415 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:14:08.472 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148 branch: wip-greg-testing-42 description: fs/verify/{begin.yaml centos_latest.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4919148' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-greg-testing-42 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: osd heartbeat grace: 40 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds heartbeat grace: 60 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow requests are blocked sha1: cbb84f71d70460f911296715ab61ac09c6962b17 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: notcmalloc sha1: cbb84f71d70460f911296715ab61ac09c6962b17 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-greg-testing-42 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 suite: fs suite_branch: wip-greg-testing-42 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cbb84f71d70460f911296715ab61ac09c6962b17 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2759 2020-04-02T23:14:08.473 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa; will attempt to use it 2020-04-02T23:14:08.473 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa/tasks 2020-04-02T23:14:08.474 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-02T23:14:08.475 INFO:teuthology.task.internal:Checking packages... 2020-04-02T23:14:08.488 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash 'cbb84f71d70460f911296715ab61ac09c6962b17' 2020-04-02T23:14:08.489 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-02T23:14:08.489 INFO:teuthology.packaging:ref: None 2020-04-02T23:14:08.489 INFO:teuthology.packaging:tag: None 2020-04-02T23:14:08.489 INFO:teuthology.packaging:branch: wip-greg-testing-42 2020-04-02T23:14:08.489 INFO:teuthology.packaging:sha1: cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:14:08.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F8%2Fx86_64&ref=wip-greg-testing-42 2020-04-02T23:14:08.735 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-316.gcbb84f7 2020-04-02T23:14:08.735 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-02T23:14:08.745 INFO:teuthology.task.internal:no buildpackages task found 2020-04-02T23:14:08.745 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-02T23:14:08.759 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-02T23:14:08.759 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:14:08.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:18.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:28.845 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:38.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:48.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:14:58.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:08.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:18.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:28.942 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:38.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:48.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:15:58.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:09.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:19.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:29.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:39.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:49.066 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:16:59.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:09.090 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:19.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:29.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:39.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:49.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:17:59.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:18:09.201 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:18:19.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:29.226 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:39.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:49.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:18:59.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:09.293 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:19.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:29.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:39.339 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:49.353 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:19:59.376 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:09.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:19.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:20:29.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:39.449 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:49.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:20:59.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:09.501 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:19.518 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:29.538 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:39.555 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:49.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:21:59.590 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:09.600 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:19.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:29.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:39.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:49.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:22:59.689 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:09.707 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:19.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:29.741 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:39.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:49.774 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:23:59.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:09.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:19.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:29.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:24:39.852 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148', 'machine_type': 'smithi'} 2020-04-02T23:24:39.872 DEBUG:teuthology.lock.ops:locked ubuntu@smithi078.front.sepia.ceph.com, ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:24:39.926 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:24:40.104 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.1 2020-04-02T23:24:40.110 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.1 2020-04-02T23:24:40.391 INFO:teuthology.orchestra.console:Power off smithi190 2020-04-02T23:24:40.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:24:40.407 INFO:teuthology.orchestra.console:Power off smithi078 2020-04-02T23:24:40.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:24:40.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:40.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:40.536 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2020-04-02T23:24:40.547 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2020-04-02T23:24:40.638 INFO:teuthology.orchestra.console:Power on smithi190 2020-04-02T23:24:40.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:24:40.649 INFO:teuthology.orchestra.console:Power on smithi078 2020-04-02T23:24:40.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:24:40.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:40.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:44.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:44.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:44.893 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2020-04-02T23:24:44.994 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2020-04-02T23:24:48.801 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:24:49.012 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2020-04-02T23:24:49.113 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2020-04-02T23:27:16.055 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:27:40.617 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:27:49.705 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:27:50.377 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:27:58.757 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:27:59.433 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:07.819 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:08.486 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:17.550 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:26.635 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:35.690 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:44.749 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:28:53.834 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:29:02.891 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:29:11.944 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:29:13.821 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:29:14.087 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.399 INFO:teuthology.orchestra.run.smithi190:> hostname 2020-04-02T23:29:14.413 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2020-04-02T23:29:14.413 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.467 INFO:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2020-04-02T23:29:14.522 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2020-04-02T23:29:14.523 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.576 INFO:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2020-04-02T23:29:14.701 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.714 INFO:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2020-04-02T23:29:14.781 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.835 INFO:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2020-04-02T23:29:14.901 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:14.955 INFO:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2020-04-02T23:29:15.022 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:29:15.075 INFO:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2020-04-02T23:29:15.141 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2020-04-02T23:29:15.143 DEBUG:teuthology.parallel:result is None 2020-04-02T23:30:18.002 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:30:18.248 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:18.536 INFO:teuthology.orchestra.run.smithi078:> hostname 2020-04-02T23:30:18.592 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2020-04-02T23:30:18.592 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:18.647 INFO:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2020-04-02T23:30:18.704 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2020-04-02T23:30:18.704 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:18.760 INFO:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2020-04-02T23:30:18.877 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:18.891 INFO:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2020-04-02T23:30:18.962 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:19.016 INFO:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2020-04-02T23:30:19.084 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:19.138 INFO:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2020-04-02T23:30:19.205 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:19.259 INFO:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2020-04-02T23:30:19.325 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2020-04-02T23:30:19.327 DEBUG:teuthology.parallel:result is None 2020-04-02T23:30:19.446 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2020-04-02T23:30:19.447 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:30:19.462 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2020-04-02T23:30:19.462 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:30:19.476 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:30:19.477 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:30:19.546 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:19.715 INFO:teuthology.orchestra.run.smithi190:> uname -m 2020-04-02T23:30:19.770 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2020-04-02T23:30:19.770 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:19.824 INFO:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2020-04-02T23:30:19.877 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Linux" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8 (Core)" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:30:19.878 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:30:19.879 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:30:19.880 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:30:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:19.881 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2020-04-02T23:30:19.893 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:30:19.893 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:30:19.959 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:20.118 INFO:teuthology.orchestra.run.smithi078:> uname -m 2020-04-02T23:30:20.171 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2020-04-02T23:30:20.172 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:20.224 INFO:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2020-04-02T23:30:20.278 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Linux" 2020-04-02T23:30:20.278 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8 (Core)" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2020-04-02T23:30:20.279 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:30:20.280 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:30:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:20.281 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2020-04-02T23:30:20.294 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-02T23:30:20.324 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7Sdx6AcOOtVT3P9DOCtzWKGLQbNigoZA5MCa+6UIMuSQVze103ln85M+qbk0uMnb1iE131YtGqOEO3FPpBXwW2VuOAmsynyfgp+uS/zMey0nT4yRTGGFpMKkvPYb79rmCZoX2PmFeIgruYOywUZhuVG+pyQEjo7ugS4fAKYn3ALMjE1qxrdPe8FDgEAApHKn9oufik8rUYAngsuDHq+FWqBmxoX5OL6LCvB2DO0537HOhinwMlrx8+7rQiKU8SR4txn2Ye3R+HJLP9KXKNmrChQT26QKymbSqA5w1bFyWEUY1rI9xXsfYT8ig53dLidyjxLEMRHfPv+ZrO5IrqkZur1DpRbaQdw4X2Vr+O4yRQZgVZ6+TPw8UCcgI2TJqJsKTKqnWf/Oq4r1kOmyOHegzQvWenNlNRo9bTCozD8loxzhhnaQutq6ln09Incltnb7C2AmR14kukGHiZKeTaWj8KT6Gg1VEbVkkRayzM18TQS8kI+1vG+cMEK19+2ZeE+0= smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLUyIJgU4iI1/whmPy6m1GrKcojp80NKMbFXwqIZaavMnNE+0WXr3eszbTchleNUMITMvesmPN0IRwQ7YDE9BQnHj4/gq2PHohcdtL3J8UdRvs08CT4mzvIMgiOTxhmeCqEOxdvAg5L+OfIj2TpQHP/yWP1zBqB2dnJ34Vdr3KshDze+ik0idOkFcq6cHbzsGEdzLDUr97eCgrBTuQFyx/DRHAgwMzez/zom84SV3x52Ht7EQiEdppSRJEyo98vNhF4TGAndhc/NCjw8hFtUux2RnLRglyF77jy7eWgetjUuiekUPkgrUNPwZkftOQ25WGqgP4KbjGYzD89EdLWdMWbLGO4j40o0ndC/k60fBktxeFinC32QRCBBNnbH0TQLvzJbRrmehZ34dLCCGnJcqibnWHV7574qdGGcf7DxCBQWNC8O3/mewqTfLZjRjQjwemLF693Z5NqeGBQ47jt8RYD3tFXzK41QV5axA79rgXGuVbkAVMyFx03O0zeX6of70= 2020-04-02T23:30:20.324 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:30:20.367 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-02T23:30:20.377 INFO:teuthology.task.internal:Saving configuration 2020-04-02T23:30:20.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-02T23:30:20.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-02T23:30:20.420 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:24:39.860285', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi190.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDuWXyiMpL+bbtw8XAKJvl+IjW5urpY3cGe2ORLqybn3yoJjZl/AYJVUhTFgdmVAYGiRGSbR8juqtw1mscsdn9k=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148'} 2020-04-02T23:30:20.434 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:24:39.860305', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi078.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBES7Q2dyg71bKmIEHrtnr9g5BEJPV4oa2R16/xI8is3jH4379ngna/gX/cwMK8LZM/7xMcaCmQ7WOUChas7k+Jw=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148'} 2020-04-02T23:30:20.434 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-02T23:30:20.445 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-04-02T23:30:20.445 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-04-02T23:30:20.445 INFO:teuthology.run_tasks:Running task console_log... 2020-04-02T23:30:20.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:30:20.507 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-02T23:30:20.517 INFO:teuthology.task.internal:Opening connections... 2020-04-02T23:30:20.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:30:20.518 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:30:20.589 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:30:20.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:30:20.659 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-02T23:30:20.669 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:20.710 INFO:teuthology.orchestra.run.smithi190:> uname -m 2020-04-02T23:30:20.764 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2020-04-02T23:30:20.765 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:20.817 INFO:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2020-04-02T23:30:20.871 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Linux" 2020-04-02T23:30:20.871 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8 (Core)" 2020-04-02T23:30:20.871 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2020-04-02T23:30:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:30:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2020-04-02T23:30:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:30:20.872 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:30:20.873 INFO:teuthology.orchestra.run.smithi190.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:30:20.874 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:30:20.874 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:30:20.874 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:20.874 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2020-04-02T23:30:20.890 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:20.905 INFO:teuthology.orchestra.run.smithi078:> uname -m 2020-04-02T23:30:20.959 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2020-04-02T23:30:20.959 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:21.012 INFO:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2020-04-02T23:30:21.065 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Linux" 2020-04-02T23:30:21.065 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8 (Core)" 2020-04-02T23:30:21.065 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2020-04-02T23:30:21.066 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:30:21.068 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:30:21.068 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:30:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:21.068 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:30:21.068 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:30:21.069 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:30:21.069 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:30:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:21.069 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2020-04-02T23:30:21.081 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-02T23:30:21.096 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-02T23:30:21.186 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-02T23:30:21.187 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:21.201 INFO:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:30:21.246 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:21.261 INFO:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:30:21.317 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-02T23:30:21.326 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-02T23:30:21.326 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:21.339 INFO:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:30:21.381 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:21.395 INFO:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:30:21.461 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-02T23:30:21.504 INFO:teuthology.run_tasks:Running task kernel... 2020-04-02T23:30:21.523 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2020-04-02T23:30:21.523 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-02T23:30:21.523 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:21.536 INFO:teuthology.orchestra.run.smithi190:> uname -r 2020-04-02T23:30:21.590 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:30:21.590 INFO:teuthology.task.kernel:Running kernel on smithi190: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:30:21.590 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:21.642 INFO:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2020-04-02T23:30:23.902 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - AppStream 35 MB/s | 6.6 MB 00:00 2020-04-02T23:30:25.060 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - Base 42 MB/s | 5.0 MB 00:00 2020-04-02T23:30:25.851 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - Extras 58 kB/s | 4.4 kB 00:00 2020-04-02T23:30:25.998 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for ceph-el8 owned by ktdreyer 461 kB/s | 47 kB 00:00 2020-04-02T23:30:26.396 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 18 MB/s | 6.2 MB 00:00 2020-04-02T23:30:27.642 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 6.1 MB/s | 30 kB 00:00 2020-04-02T23:30:28.564 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:30:28.565 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:30:28.747 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2020-04-02T23:30:28.748 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2020-04-02T23:30:28.749 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2020-04-02T23:30:28.873 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:28.927 INFO:teuthology.orchestra.run.smithi190:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:30:29.355 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:30:27 PM UTC. 2020-04-02T23:30:29.705 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2020-04-02T23:30:29.705 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:29.705 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalling: 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2020-04-02T23:30:29.706 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:29.707 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:29.707 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 3.1 M 2020-04-02T23:30:29.707 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 0 2020-04-02T23:30:29.708 INFO:teuthology.orchestra.run.smithi190.stderr:Operation aborted. 2020-04-02T23:30:29.797 INFO:teuthology.orchestra.run.smithi190.stdout:Is this ok [y/N]: 2020-04-02T23:30:29.797 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:29.810 INFO:teuthology.orchestra.run.smithi190:> sudo yum reinstall -y kernel || true 2020-04-02T23:30:30.237 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:30:27 PM UTC. 2020-04-02T23:30:30.587 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2020-04-02T23:30:30.587 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalling: 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:30.588 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2020-04-02T23:30:30.589 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:30:30.589 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:30.589 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 3.1 M 2020-04-02T23:30:30.590 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 0 2020-04-02T23:30:30.590 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2020-04-02T23:30:30.649 INFO:teuthology.orchestra.run.smithi190.stdout:(1/2): kernel-4.18.0-147.el8.x86_64.rpm 25 MB/s | 1.5 MB 00:00 2020-04-02T23:30:30.661 INFO:teuthology.orchestra.run.smithi190.stdout:(2/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 21 MB/s | 1.5 MB 00:00 2020-04-02T23:30:30.662 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:30:30.662 INFO:teuthology.orchestra.run.smithi190.stdout:Total 41 MB/s | 3.1 MB 00:00 2020-04-02T23:30:30.686 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2020-04-02T23:30:30.865 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2020-04-02T23:30:30.865 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2020-04-02T23:30:30.932 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2020-04-02T23:30:30.932 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2020-04-02T23:30:31.079 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2020-04-02T23:30:31.240 INFO:teuthology.orchestra.run.smithi190.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:30:31.365 INFO:teuthology.orchestra.run.smithi190.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:30:31.366 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:31.458 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:31.458 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:30:31.675 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:30:31.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:30:31.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:30:31.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:32.048 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:30:32.048 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:32.049 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalled: 2020-04-02T23:30:32.049 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:30:32.049 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:32.049 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2020-04-02T23:30:32.139 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:32.152 INFO:teuthology.orchestra.run.smithi190:> rpm -q kernel --last | head -n 1 2020-04-02T23:30:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:30:31 PM UTC 2020-04-02T23:30:32.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:30:32.255 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:30:32.255 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:32.271 INFO:teuthology.orchestra.run.smithi078:> uname -r 2020-04-02T23:30:32.327 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:30:32.327 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:30:32.327 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:32.382 INFO:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2020-04-02T23:30:34.818 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - AppStream 40 MB/s | 6.6 MB 00:00 2020-04-02T23:30:35.980 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Base 39 MB/s | 5.0 MB 00:00 2020-04-02T23:30:36.775 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Extras 67 kB/s | 4.4 kB 00:00 2020-04-02T23:30:36.914 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for ceph-el8 owned by ktdreyer 499 kB/s | 47 kB 00:00 2020-04-02T23:30:37.307 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 18 MB/s | 6.2 MB 00:00 2020-04-02T23:30:38.572 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 5.8 MB/s | 30 kB 00:00 2020-04-02T23:30:39.490 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:30:39.490 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:30:39.645 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2020-04-02T23:30:39.646 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2020-04-02T23:30:39.646 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2020-04-02T23:30:39.787 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:39.841 INFO:teuthology.orchestra.run.smithi078:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:30:40.271 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:30:38 PM UTC. 2020-04-02T23:30:40.604 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout:Reinstalling: 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:30:40.605 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:30:40.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:40.606 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2020-04-02T23:30:40.606 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:40.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:40.607 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 3.1 M 2020-04-02T23:30:40.607 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 0 2020-04-02T23:30:40.607 INFO:teuthology.orchestra.run.smithi078.stderr:Operation aborted. 2020-04-02T23:30:40.727 INFO:teuthology.orchestra.run.smithi078.stdout:Is this ok [y/N]: 2020-04-02T23:30:40.727 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:40.741 INFO:teuthology.orchestra.run.smithi078:> sudo yum reinstall -y kernel || true 2020-04-02T23:30:41.169 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:30:38 PM UTC. 2020-04-02T23:30:41.501 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2020-04-02T23:30:41.502 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:41.502 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2020-04-02T23:30:41.502 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:41.502 INFO:teuthology.orchestra.run.smithi078.stdout:Reinstalling: 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:30:41.503 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:41.504 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 3.1 M 2020-04-02T23:30:41.504 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 0 2020-04-02T23:30:41.504 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2020-04-02T23:30:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 30 MB/s | 1.5 MB 00:00 2020-04-02T23:30:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2020-04-02T23:30:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:30:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:Total 45 MB/s | 3.1 MB 00:00 2020-04-02T23:30:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2020-04-02T23:30:41.769 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2020-04-02T23:30:41.769 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2020-04-02T23:30:41.844 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2020-04-02T23:30:41.844 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2020-04-02T23:30:41.975 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2020-04-02T23:30:42.138 INFO:teuthology.orchestra.run.smithi078.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:30:42.264 INFO:teuthology.orchestra.run.smithi078.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:30:42.265 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:42.390 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:42.390 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:30:42.607 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:30:42.607 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:30:42.607 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:30:42.607 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:30:42.975 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:30:42.975 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:42.975 INFO:teuthology.orchestra.run.smithi078.stdout:Reinstalled: 2020-04-02T23:30:42.976 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:30:42.976 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:30:42.976 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2020-04-02T23:30:43.094 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:30:43.108 INFO:teuthology.orchestra.run.smithi078:> rpm -q kernel --last | head -n 1 2020-04-02T23:30:43.210 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Thu 02 Apr 2020 11:30:42 PM UTC 2020-04-02T23:30:43.217 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:30:43.217 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-02T23:30:43.218 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-04-02T23:30:43.218 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:30:43.218 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-04-02T23:30:43.218 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:30:43.218 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:43.235 INFO:teuthology.orchestra.run.smithi190:> rpm -q kernel --last | head -n 1 2020-04-02T23:30:43.321 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:30:31 PM UTC 2020-04-02T23:30:43.324 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:30:43.324 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:43.339 INFO:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2020-04-02T23:30:43.414 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2020-04-02T23:30:43.414 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2020-04-02T23:30:43.414 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.02 2020-04-02T23:30:43.414 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 78.el8 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Group : System Environment/Base 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 9192691 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:30:43.415 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Relocations : (not relocatable) 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : CentOS BuildSystem 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : CentOS 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:30:43.416 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:30:43.417 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:30:43.418 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:30:43.418 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:30:43.419 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:43.473 INFO:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:30:44.703 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2020-04-02T23:30:46.622 INFO:teuthology.orchestra.run.smithi190.stderr:done 2020-04-02T23:30:46.624 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:46.638 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:30:46.692 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.pkgoCkGcto 2020-04-02T23:30:46.693 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:46.745 INFO:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pkgoCkGcto 2020-04-02T23:30:46.821 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:46.874 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.pkgoCkGcto 2020-04-02T23:30:47.010 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.pkgoCkGcto is 4KB 2020-04-02T23:30:47.059 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:47.072 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.pkgoCkGcto 2020-04-02T23:30:47.125 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:47.177 INFO:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:30:47.264 INFO:teuthology.orchestra.run.smithi190.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:30:47.264 INFO:teuthology.orchestra.run.smithi190.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:30:47.264 INFO:teuthology.orchestra.run.smithi190.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:30:47.265 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:47.278 INFO:teuthology.orchestra.run.smithi190:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:30:47.452 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:30:47.465 INFO:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2020-04-02T23:31:17.508 INFO:teuthology.misc:Re-opening connections... 2020-04-02T23:31:17.508 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:31:17.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:17.509 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:31:36.025 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2020-04-02T23:31:36.025 INFO:teuthology.misc:trying to connect to ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:31:36.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:36.027 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:31:36.098 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:31:36.266 DEBUG:teuthology.misc:waited 18.7578849792 2020-04-02T23:31:37.267 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:31:37.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:37.269 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:31:40.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2020-04-02T23:31:40.341 DEBUG:teuthology.misc:waited 22.8324718475 2020-04-02T23:31:41.342 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:31:41.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:41.343 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:31:43.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2020-04-02T23:31:43.413 DEBUG:teuthology.misc:waited 25.9045138359 2020-04-02T23:31:44.413 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:31:44.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:44.414 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:31:46.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2020-04-02T23:31:46.485 DEBUG:teuthology.misc:waited 28.9765210152 2020-04-02T23:31:47.486 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:31:47.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:31:47.487 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:32:47.488 DEBUG:teuthology.orchestra.remote:timed out 2020-04-02T23:32:47.489 DEBUG:teuthology.misc:waited 89.9802320004 2020-04-02T23:32:48.489 INFO:teuthology.misc:trying to connect to ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:32:48.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:32:48.490 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:32:48.745 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:49.055 DEBUG:teuthology.misc:waited 91.5464279652 2020-04-02T23:32:50.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-04-02T23:32:50.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:32:50.056 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:50.072 INFO:teuthology.orchestra.run.smithi190:> uname -r 2020-04-02T23:32:50.128 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:32:50.129 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:32:50.129 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:32:51.130 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-02T23:32:51.130 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:51.146 INFO:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:32:51.294 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2020-04-02T23:32:51.308 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-02T23:32:51.308 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:51.325 INFO:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:32:51.408 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2020-04-02T23:32:51.422 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-02T23:32:51.436 INFO:teuthology.task.internal:Creating test directory... 2020-04-02T23:32:51.437 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:51.477 INFO:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:32:51.519 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:51.536 INFO:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:32:51.601 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-02T23:32:51.612 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-02T23:32:51.625 INFO:teuthology.task.internal:Creating archive directory... 2020-04-02T23:32:51.625 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:51.639 INFO:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:32:51.681 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:51.697 INFO:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:32:51.760 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-02T23:32:51.771 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-02T23:32:51.771 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:51.785 INFO:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:32:51.828 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:51.843 INFO:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:32:51.876 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:32:51.891 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:32:51.915 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:32:51.930 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:32:51.932 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-02T23:32:51.942 INFO:teuthology.task.internal:Configuring sudo... 2020-04-02T23:32:51.942 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:51.956 INFO:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:32:51.998 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.013 INFO:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:32:52.081 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-02T23:32:52.094 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-02T23:32:52.094 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:52.108 INFO:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:32:52.150 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.164 INFO:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:32:52.219 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.272 INFO:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:32:52.345 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.382 INFO:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:32:52.458 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.512 INFO:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:32:52.583 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.620 INFO:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:32:52.686 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:52.739 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:32:52.824 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:52.840 INFO:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:32:52.915 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:52.955 INFO:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:32:53.038 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:53.093 INFO:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:32:53.165 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:53.206 INFO:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:32:53.275 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:53.329 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:32:53.415 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:53.468 INFO:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2020-04-02T23:32:53.510 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:53.525 INFO:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2020-04-02T23:32:53.573 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:32:53.631 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:32:54.057 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-02T23:32:54.072 INFO:teuthology.task.internal:Starting timer... 2020-04-02T23:32:54.072 INFO:teuthology.run_tasks:Running task pcp... 2020-04-02T23:32:54.119 INFO:teuthology.run_tasks:Running task selinux... 2020-04-02T23:32:54.137 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-02T23:32:54.137 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:54.151 INFO:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2020-04-02T23:32:54.265 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: [ OK ] 2020-04-02T23:32:54.266 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:54.283 INFO:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2020-04-02T23:32:54.405 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: [ OK ] 2020-04-02T23:32:54.406 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-02T23:32:54.406 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:54.419 INFO:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2020-04-02T23:32:54.485 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2020-04-02T23:32:54.486 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:54.499 INFO:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2020-04-02T23:32:54.557 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2020-04-02T23:32:54.557 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': u'permissive'} 2020-04-02T23:32:54.558 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:54.571 INFO:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:32:54.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:32:54.640 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:54.653 INFO:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:32:54.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:32:54.721 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-02T23:32:54.721 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:32:54.735 INFO:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:32:54.801 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:32:54.815 INFO:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:32:54.883 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-02T23:32:54.898 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-04-02T23:32:54.898 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-02T23:32:54.913 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-02T23:32:54.915 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi190.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-02T23:32:55.247 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-02T23:32:56.364 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-02T23:32:59.404 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-02T23:32:59.426 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:32:59 +0000 (0:00:00.060) 0:00:00.060 ******** 2020-04-02T23:32:59.438 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:32:59 +0000 (0:00:00.011) 0:00:00.072 ******** 2020-04-02T23:33:02.862 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-02T23:33:02.863 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] 2020-04-02T23:33:02.948 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:02 +0000 (0:00:03.509) 0:00:03.582 ******** 2020-04-02T23:33:02.968 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] 2020-04-02T23:33:03.048 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:03 +0000 (0:00:00.097) 0:00:03.679 ******** 2020-04-02T23:33:03.278 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-02T23:33:03.280 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:33:03.322 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:03 +0000 (0:00:00.277) 0:00:03.957 ******** 2020-04-02T23:33:03.355 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:03 +0000 (0:00:00.032) 0:00:03.989 ******** 2020-04-02T23:33:03.894 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-02T23:33:03.895 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:33:03.936 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:03 +0000 (0:00:00.580) 0:00:04.570 ******** 2020-04-02T23:33:03.942 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:33:03.981 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:03 +0000 (0:00:00.044) 0:00:04.615 ******** 2020-04-02T23:33:03.986 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:33:03.987 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:04.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:04 +0000 (0:00:00.046) 0:00:04.661 ******** 2020-04-02T23:33:04.033 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:04.074 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:04 +0000 (0:00:00.047) 0:00:04.709 ******** 2020-04-02T23:33:04.357 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-02T23:33:04.358 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:33:04.401 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:04 +0000 (0:00:00.326) 0:00:05.035 ******** 2020-04-02T23:33:04.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:04 +0000 (0:00:00.033) 0:00:05.069 ******** 2020-04-02T23:33:05.257 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-02T23:33:05.258 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585870384.45-10175088077116/source", "state": "file", "uid": 0} 2020-04-02T23:33:05.299 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:05 +0000 (0:00:00.863) 0:00:05.933 ******** 2020-04-02T23:33:05.304 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585870384.42-115541459701363/source", "state": "file", "uid": 0} 2020-04-02T23:33:05.342 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:05 +0000 (0:00:00.043) 0:00:05.976 ******** 2020-04-02T23:33:05.827 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-02T23:33:05.827 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:33:05.829 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:33:05.880 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:33:05.882 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:33:06.000 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-02T23:33:06.007 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-02T23:33:06.218 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:06 +0000 (0:00:00.875) 0:00:06.852 ******** 2020-04-02T23:33:06.255 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:06 +0000 (0:00:00.037) 0:00:06.889 ******** 2020-04-02T23:33:06.870 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi078.front.sepia.ceph.com] 2020-04-02T23:33:06.974 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-02T23:33:06.976 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:06 +0000 (0:00:00.719) 0:00:07.608 ******** 2020-04-02T23:33:06.985 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] 2020-04-02T23:33:07.070 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.095) 0:00:07.704 ******** 2020-04-02T23:33:07.624 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-02T23:33:07.626 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.229033", "end": "2020-04-02 23:33:07.600393", "rc": 0, "start": "2020-04-02 23:33:07.371360", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} changed: [smithi190.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.232055", "end": "2020-04-02 23:33:07.598821", "rc": 0, "start": "2020-04-02 23:33:07.366766", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:33:07.662 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.591) 0:00:08.296 ******** 2020-04-02T23:33:07.695 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.032) 0:00:08.329 ******** 2020-04-02T23:33:07.866 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011375", "end": "2020-04-02 23:33:07.848136", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:33:07.836761", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:33:07.907 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.212) 0:00:08.541 ******** 2020-04-02T23:33:07.919 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007682", "end": "2020-04-02 23:33:07.888996", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:33:07.881314", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:33:07.952 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.044) 0:00:08.586 ******** 2020-04-02T23:33:07.957 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-02T23:33:07.958 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:33:07.996 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:07 +0000 (0:00:00.044) 0:00:08.630 ******** 2020-04-02T23:33:08.003 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:33:08.040 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.043) 0:00:08.674 ******** 2020-04-02T23:33:08.045 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-02T23:33:08.047 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.083 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.043) 0:00:08.717 ******** 2020-04-02T23:33:08.088 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.126 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.042) 0:00:08.760 ******** 2020-04-02T23:33:08.131 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-02T23:33:08.132 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.170 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.043) 0:00:08.804 ******** 2020-04-02T23:33:08.176 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.214 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.044) 0:00:08.848 ******** 2020-04-02T23:33:08.221 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-02T23:33:08.223 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.260 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.045) 0:00:08.893 ******** 2020-04-02T23:33:08.265 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.302 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.042) 0:00:08.936 ******** 2020-04-02T23:33:08.307 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-02T23:33:08.310 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.346 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.044) 0:00:08.981 ******** 2020-04-02T23:33:08.353 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.391 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.044) 0:00:09.025 ******** 2020-04-02T23:33:08.396 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-02T23:33:08.396 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.434 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.043) 0:00:09.068 ******** 2020-04-02T23:33:08.440 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.479 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:08 +0000 (0:00:00.044) 0:00:09.113 ******** 2020-04-02T23:33:08.485 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-02T23:33:08.485 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.487 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.488 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.488 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac 2020-04-02T23:33:08.489 INFO:teuthology.task.ansible.out:1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.499 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.500 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.515 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.516 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.532 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.532 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.534 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.534 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.539 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.546 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.547 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.558 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.559 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.570 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.572 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.581 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.582 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.593 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.593 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.605 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.606 INFO:teuthology.task.ansible.out: skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.606 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.608 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.608 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.co 2020-04-02T23:33:08.609 INFO:teuthology.task.ansible.out:m] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.619 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.620 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.621 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.632 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.633 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.635 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.635 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654 2020-04-02T23:33:08.636 INFO:teuthology.task.ansible.out:\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.646 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.647 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.649 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.658 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.659 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.660 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.661 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.672 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.672 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.684 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.685 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.687 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.697 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.697 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.699 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.699 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.700 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.710 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.711 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.712 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.723 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.723 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.725 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.735 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.736 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.737 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.738 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.749 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.750 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.752 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.762 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.763 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.764 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.774 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.775 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.776 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.787 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.787 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.799 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.799 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.810 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.811 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.812 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.822 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.823 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.829 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.835 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.837 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.838 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.840 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.841 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.852 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.852 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.854 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.864 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.865 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.869 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.871 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.872 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.874 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.885 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.886 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.887 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.889 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.899 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.899 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.901 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.905 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.907 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.908 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.920 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.921 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.924 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.925 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.927 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.928 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.939 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.939 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.941 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.951 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.952 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.953 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.968 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.973 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.973 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.975 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.976 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.976 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.988 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.989 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:08.990 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.001 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.002 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.004 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.018 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.019 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.020 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.029 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.043 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.044 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.059 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_lo 2020-04-02T23:33:09.062 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed 2020-04-02T23:33:09.064 INFO:teuthology.task.ansible.out:": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.065 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.066 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.067 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.078 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.080 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.091 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.091 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.093 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.104 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.104 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.106 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.106 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.107 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.118 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.120 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.120 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.122 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.136 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.140 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.146 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.147 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.149 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.150 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.161 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.162 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.164 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.165 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.167 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.178 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.179 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.181 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.183 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.195 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.197 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.198 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.199 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.201 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.202 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.203 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.205 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.215 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.216 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.241 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.292 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.812) 0:00:09.926 ******** 2020-04-02T23:33:09.327 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.035) 0:00:09.961 ******** 2020-04-02T23:33:09.334 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-02T23:33:09.372 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.044) 0:00:10.006 ******** 2020-04-02T23:33:09.418 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.052 ******** 2020-04-02T23:33:09.423 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-02T23:33:09.428 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.467 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.049) 0:00:10.101 ******** 2020-04-02T23:33:09.473 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.047) 0:00:10.149 ******** 2020-04-02T23:33:09.521 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-02T23:33:09.522 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.560 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.194 ******** 2020-04-02T23:33:09.567 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.605 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.240 ******** 2020-04-02T23:33:09.611 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-02T23:33:09.612 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.650 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.044) 0:00:10.284 ******** 2020-04-02T23:33:09.658 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.696 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.330 ******** 2020-04-02T23:33:09.702 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-02T23:33:09.703 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.742 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.376 ******** 2020-04-02T23:33:09.748 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.787 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.045) 0:00:10.421 ******** 2020-04-02T23:33:09.793 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-02T23:33:09.795 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.845 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.052) 0:00:10.474 ******** 2020-04-02T23:33:09.846 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.897 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:09 +0000 (0:00:00.056) 0:00:10.531 ******** 2020-04-02T23:33:09.903 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-02T23:33:09.904 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.905 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.906 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.907 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.908 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.919 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.933 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.943 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.944 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.946 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.956 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.957 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.958 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.960 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.971 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.972 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.974 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.975 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.987 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.988 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.990 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.991 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.991 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:09.993 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.003 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.004 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.005 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.020 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.021 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.023 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.024 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.026 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.036 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.036 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.037 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.038 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.048 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.049 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.050 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.062 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.063 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.064 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.065 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.067 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.078 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.078 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.080 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.090 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.091 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.092 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.103 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.103 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.104 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.115 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.115 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.117 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.133 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.139 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.139 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.141 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.189 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:10 +0000 (0:00:00.292) 0:00:10.823 ******** 2020-04-02T23:33:10.194 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.195 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.197 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.197 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.199 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:10.246 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:10 +0000 (0:00:00.056) 0:00:10.880 ******** 2020-04-02T23:33:10.973 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-02T23:33:10.973 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:33:10.975 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:33:11.011 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.765) 0:00:11.645 ******** 2020-04-02T23:33:11.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.035) 0:00:11.681 ******** 2020-04-02T23:33:11.052 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-02T23:33:11.054 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => { "msg": "Host smithi078.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:33:11.091 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.044) 0:00:11.725 ******** 2020-04-02T23:33:11.097 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => { "msg": "Host smithi190.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:33:11.135 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.043) 0:00:11.769 ******** 2020-04-02T23:33:11.141 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-02T23:33:11.141 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:33:11.183 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.045) 0:00:11.814 ******** 2020-04-02T23:33:11.187 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:33:11.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.046) 0:00:11.860 ******** 2020-04-02T23:33:11.232 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-02T23:33:11.233 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.270 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.043) 0:00:11.904 ******** 2020-04-02T23:33:11.275 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.043) 0:00:11.947 ******** 2020-04-02T23:33:11.546 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-02T23:33:11.548 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.075721", "end": "2020-04-02 23:33:11.521073", "rc": 0, "start": "2020-04-02 23:33:11.445352", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:33:11.584 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.270) 0:00:12.218 ******** 2020-04-02T23:33:11.600 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.088519", "end": "2020-04-02 23:33:11.576037", "rc": 0, "start": "2020-04-02 23:33:11.487518", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:33:11.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.052) 0:00:12.270 ******** 2020-04-02T23:33:11.641 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-02T23:33:11.642 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.683 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.046) 0:00:12.317 ******** 2020-04-02T23:33:11.689 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.728 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.044) 0:00:12.362 ******** 2020-04-02T23:33:11.736 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-02T23:33:11.736 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.776 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.047) 0:00:12.410 ******** 2020-04-02T23:33:11.782 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.043) 0:00:12.453 ******** 2020-04-02T23:33:11.825 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.862 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.042) 0:00:12.496 ******** 2020-04-02T23:33:11.869 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.907 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.043) 0:00:12.540 ******** 2020-04-02T23:33:11.911 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-02T23:33:11.911 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.949 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.042) 0:00:12.583 ******** 2020-04-02T23:33:11.956 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:11.994 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:11 +0000 (0:00:00.044) 0:00:12.627 ******** 2020-04-02T23:33:11.999 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-02T23:33:11.999 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.054 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.043) 0:00:12.671 ******** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.085 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.047) 0:00:12.719 ******** 2020-04-02T23:33:12.090 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-02T23:33:12.097 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.128 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.043) 0:00:12.762 ******** 2020-04-02T23:33:12.134 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.044) 0:00:12.806 ******** 2020-04-02T23:33:12.181 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi078.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:12.222 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.049) 0:00:12.856 ******** 2020-04-02T23:33:12.227 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:12.227 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:12.274 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.051) 0:00:12.908 ******** 2020-04-02T23:33:12.279 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-02T23:33:12.280 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.323 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.049) 0:00:12.957 ******** 2020-04-02T23:33:12.329 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.371 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.048) 0:00:13.005 ******** 2020-04-02T23:33:12.376 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-02T23:33:12.378 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.419 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.048) 0:00:13.053 ******** 2020-04-02T23:33:12.425 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.467 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.047) 0:00:13.101 ******** 2020-04-02T23:33:12.475 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-02T23:33:12.477 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:12.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.046) 0:00:13.147 ******** 2020-04-02T23:33:12.519 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:12.564 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.050) 0:00:13.198 ******** 2020-04-02T23:33:12.756 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 02 April 2020 23:33:12 +0000 (0:00:00.047) 0:00:13.246 ******** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 02 April 2020 23:33:12 +0000 (0:00:00.044) 0:00:13.290 ******** TASK [common : Register with subscription-manager.] **************************** skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Thursday 02 April 2020 23:33:12 +0000 (0:00:00.044) 0:00:13.335 ******** skipping: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Thursday 02 April 2020 23:33:12 +0000 (0:00:00.043) 0:00:13.379 ******** TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.793 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.047) 0:00:13.427 ******** 2020-04-02T23:33:12.800 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.836 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.043) 0:00:13.470 ******** 2020-04-02T23:33:12.841 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-02T23:33:12.841 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.881 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.044) 0:00:13.515 ******** 2020-04-02T23:33:12.888 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.927 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.046) 0:00:13.561 ******** 2020-04-02T23:33:12.932 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-02T23:33:12.935 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:12.972 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:12 +0000 (0:00:00.044) 0:00:13.606 ******** 2020-04-02T23:33:12.978 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.016 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.044) 0:00:13.650 ******** 2020-04-02T23:33:13.023 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-02T23:33:13.024 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.065 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.048) 0:00:13.699 ******** 2020-04-02T23:33:13.071 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.121 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.054) 0:00:13.754 ******** 2020-04-02T23:33:13.125 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-02T23:33:13.126 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:13.168 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.048) 0:00:13.802 ******** 2020-04-02T23:33:13.175 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:13.215 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.045) 0:00:13.848 ******** 2020-04-02T23:33:13.220 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:33:13.221 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.044) 0:00:13.893 ******** 2020-04-02T23:33:13.267 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.305 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.045) 0:00:13.939 ******** 2020-04-02T23:33:13.310 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-02T23:33:13.311 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.351 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.045) 0:00:13.984 ******** 2020-04-02T23:33:13.356 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.395 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.044) 0:00:14.029 ******** 2020-04-02T23:33:13.400 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-02T23:33:13.400 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.439 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.043) 0:00:14.073 ******** 2020-04-02T23:33:13.445 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.483 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.044) 0:00:14.117 ******** 2020-04-02T23:33:13.490 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-02T23:33:13.492 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.529 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.045) 0:00:14.163 ******** 2020-04-02T23:33:13.535 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.574 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.044) 0:00:14.208 ******** 2020-04-02T23:33:13.578 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-02T23:33:13.580 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.626 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.050) 0:00:14.258 ******** 2020-04-02T23:33:13.630 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.669 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.045) 0:00:14.303 ******** 2020-04-02T23:33:13.676 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-02T23:33:13.677 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.047) 0:00:14.351 ******** 2020-04-02T23:33:13.946 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:13.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:13 +0000 (0:00:00.274) 0:00:14.625 ******** 2020-04-02T23:33:13.996 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-02T23:33:13.997 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:14.036 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.044) 0:00:14.670 ******** 2020-04-02T23:33:14.040 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:33:14.081 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.044) 0:00:14.715 ******** 2020-04-02T23:33:14.086 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-02T23:33:14.125 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.043) 0:00:14.759 ******** 2020-04-02T23:33:14.170 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.045) 0:00:14.804 ******** 2020-04-02T23:33:14.175 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-02T23:33:14.178 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:14.215 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.044) 0:00:14.849 ******** 2020-04-02T23:33:14.221 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:14.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.044) 0:00:14.893 ******** 2020-04-02T23:33:14.441 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-02T23:33:14.441 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:33:14.480 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.220) 0:00:15.113 ******** 2020-04-02T23:33:14.496 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:33:14.536 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:14 +0000 (0:00:00.056) 0:00:15.170 ******** 2020-04-02T23:33:14.984 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-02T23:33:14.985 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:33:15.046 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:33:15.454 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:33:15.514 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:15 +0000 (0:00:00.978) 0:00:16.149 ******** 2020-04-02T23:33:15.575 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:33:15.651 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:15 +0000 (0:00:00.136) 0:00:16.285 ******** 2020-04-02T23:33:16.012 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:33:16.012 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:33:16.130 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:33:16.486 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:33:16.545 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.894) 0:00:17.180 ******** 2020-04-02T23:33:16.574 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:33:16.576 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.621 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.068) 0:00:17.248 ******** TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi190.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:33:16.660 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.046) 0:00:17.294 ******** 2020-04-02T23:33:16.666 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:33:16.666 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.707 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.047) 0:00:17.341 ******** 2020-04-02T23:33:16.713 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:33:16.714 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.755 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.047) 0:00:17.389 ******** 2020-04-02T23:33:16.760 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:33:16.761 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.800 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.045) 0:00:17.435 ******** 2020-04-02T23:33:16.806 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:33:16.808 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.844 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.043) 0:00:17.478 ******** 2020-04-02T23:33:16.849 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:33:16.851 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.888 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.044) 0:00:17.522 ******** 2020-04-02T23:33:16.894 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:33:16.895 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.931 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.042) 0:00:17.565 ******** 2020-04-02T23:33:16.936 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:33:16.941 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:16.984 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:16 +0000 (0:00:00.049) 0:00:17.614 ******** 2020-04-02T23:33:16.986 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:33:16.986 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.024 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:17.658 ******** 2020-04-02T23:33:17.029 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:33:17.030 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.067 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:17.701 ******** 2020-04-02T23:33:17.074 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:33:17.076 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.114 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.047) 0:00:17.748 ******** 2020-04-02T23:33:17.120 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:33:17.120 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.157 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.042) 0:00:17.791 ******** 2020-04-02T23:33:17.169 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.201 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:17.835 ******** 2020-04-02T23:33:17.206 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:33:17.208 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.244 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:17.878 ******** 2020-04-02T23:33:17.250 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:33:17.251 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.288 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:17.922 ******** 2020-04-02T23:33:17.300 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:33:17.301 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.336 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.048) 0:00:17.970 ******** 2020-04-02T23:33:17.352 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.380 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.043) 0:00:18.014 ******** 2020-04-02T23:33:17.416 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:17.453 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:17 +0000 (0:00:00.073) 0:00:18.087 ******** 2020-04-02T23:33:18.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-02T23:33:18.523 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.872980", "end": "2020-04-02 23:33:18.500400", "rc": 0, "start": "2020-04-02 23:33:17.627420", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.986133", "end": "2020-04-02 23:33:18.500318", "rc": 0, "start": "2020-04-02 23:33:17.514185", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:33:18.569 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:18 +0000 (0:00:01.116) 0:00:19.203 ******** 2020-04-02T23:33:18.608 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:18 +0000 (0:00:00.038) 0:00:19.242 ******** 2020-04-02T23:33:19.663 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-02T23:33:19.665 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:33:19.702 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:19 +0000 (0:00:01.093) 0:00:20.336 ******** 2020-04-02T23:33:19.729 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-02T23:33:19.730 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:19.766 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:19 +0000 (0:00:00.064) 0:00:20.400 ******** 2020-04-02T23:33:19.792 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:33:19.794 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:19.830 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:19 +0000 (0:00:00.064) 0:00:20.464 ******** 2020-04-02T23:33:19.857 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-02T23:33:19.858 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:19.894 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:19 +0000 (0:00:00.063) 0:00:20.528 ******** 2020-04-02T23:33:19.917 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:33:19.918 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:19.954 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:19 +0000 (0:00:00.059) 0:00:20.588 ******** 2020-04-02T23:33:20.403 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-02T23:33:20.404 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:33:20.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:20 +0000 (0:00:00.486) 0:00:21.075 ******** 2020-04-02T23:33:21.323 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-02T23:33:21.325 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:33:21.361 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.920) 0:00:21.995 ******** 2020-04-02T23:33:21.544 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-02T23:33:21.545 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:33:21.582 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.220) 0:00:22.216 ******** 2020-04-02T23:33:21.608 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-02T23:33:21.609 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:21.644 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.062) 0:00:22.278 ******** 2020-04-02T23:33:21.669 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:33:21.671 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:21.705 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.060) 0:00:22.339 ******** 2020-04-02T23:33:21.730 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-02T23:33:21.732 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:21.767 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.062) 0:00:22.401 ******** 2020-04-02T23:33:21.793 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:33:21.794 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:21.828 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:21 +0000 (0:00:00.061) 0:00:22.462 ******** 2020-04-02T23:33:21.854 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:33:21.859 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:33:22.291 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-02T23:33:22.293 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:33:22.332 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:22 +0000 (0:00:00.504) 0:00:22.967 ******** 2020-04-02T23:33:22.338 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:33:22.339 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:33:22.762 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:33:22.808 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:22 +0000 (0:00:00.475) 0:00:23.442 ******** 2020-04-02T23:33:23.013 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-02T23:33:23.013 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:33:23.054 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:23 +0000 (0:00:00.246) 0:00:23.688 ******** 2020-04-02T23:33:23.230 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:33:23.275 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:23 +0000 (0:00:00.220) 0:00:23.909 ******** 2020-04-02T23:33:23.543 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:33:23.543 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:33:23.773 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi190.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:33:24.041 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:33:24.043 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:33:24.235 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:33:24.237 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:33:24.478 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:33:24.479 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:33:24.525 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:01.249) 0:00:25.159 ******** 2020-04-02T23:33:24.551 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:33:24.552 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:24.593 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:00.068) 0:00:25.227 ******** 2020-04-02T23:33:24.645 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:33:24.684 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:00.090) 0:00:25.318 ******** 2020-04-02T23:33:24.690 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:33:24.690 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:33:24.731 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:00.047) 0:00:25.365 ******** 2020-04-02T23:33:24.893 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:33:24.895 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:33:24.933 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:00.201) 0:00:25.567 ******** 2020-04-02T23:33:24.937 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-02T23:33:24.938 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:33:24.987 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:24 +0000 (0:00:00.053) 0:00:25.621 ******** 2020-04-02T23:33:24.992 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:33:24.993 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:24.994 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:24.996 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:25.006 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:25.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:25 +0000 (0:00:00.059) 0:00:25.681 ******** 2020-04-02T23:33:25.472 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:33:25.473 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:33:25.925 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:33:25.978 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-02T23:33:25.980 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:33:26.018 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.971) 0:00:26.652 ******** 2020-04-02T23:33:26.054 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:33:26.056 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.092 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.073) 0:00:26.726 ******** 2020-04-02T23:33:26.366 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:33:26.368 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:33:26.411 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.318) 0:00:27.045 ******** 2020-04-02T23:33:26.437 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:33:26.438 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.476 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.065) 0:00:27.110 ******** 2020-04-02T23:33:26.513 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:33:26.552 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.076) 0:00:27.186 ******** 2020-04-02T23:33:26.553 INFO:teuthology.task.ansible.out: 2020-04-02T23:33:26.569 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-02T23:33:26.569 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:33:26.616 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.064) 0:00:27.250 ******** 2020-04-02T23:33:26.752 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:33:26.753 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:33:26.792 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.175) 0:00:27.426 ******** 2020-04-02T23:33:26.834 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:33:26.834 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.845 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.856 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.871 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:33:26.910 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:26 +0000 (0:00:00.118) 0:00:27.544 ******** 2020-04-02T23:33:27.085 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:33:27.086 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:33:27.125 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.214) 0:00:27.759 ******** 2020-04-02T23:33:27.162 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:33:27.163 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:27.199 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.073) 0:00:27.833 ******** 2020-04-02T23:33:27.395 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:33:27.397 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:33:27.442 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.242) 0:00:28.075 ******** 2020-04-02T23:33:27.687 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi078.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:33:27.726 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.284) 0:00:28.360 ******** 2020-04-02T23:33:27.753 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:33:27.754 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:27.793 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.066) 0:00:28.427 ******** 2020-04-02T23:33:27.833 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:33:27.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.078) 0:00:28.505 ******** 2020-04-02T23:33:27.897 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:33:27.899 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:27.945 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:27 +0000 (0:00:00.073) 0:00:28.578 ******** 2020-04-02T23:33:28.266 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:33:28.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:28 +0000 (0:00:00.363) 0:00:28.942 ******** 2020-04-02T23:33:28.412 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-02T23:33:28.420 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:33:28.451 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:28 +0000 (0:00:00.142) 0:00:29.085 ******** 2020-04-02T23:33:28.931 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:33:28.932 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:33:28.969 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:28 +0000 (0:00:00.518) 0:00:29.603 ******** 2020-04-02T23:33:28.995 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:33:28.996 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:29.032 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.062) 0:00:29.666 ******** 2020-04-02T23:33:29.133 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:33:29.135 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:29:40 UTC", "ActiveEnterTimestampMonotonic": "14416223", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target var-run.mount systemd-tmpfiles-setup.service tmp.mount basic.target local-fs.target nss-lookup.target systemd-journald.socket system.slice time-sync.target -.mount network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:29:40 UTC", "AssertTimestampMonotonic": "14415530", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:29:40 UTC", "ConditionTimestampMonotonic": "14415530", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:33:29.137 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2419", "ExecMainStartTimestamp": "Thu 2020-04-02 23:29:40 UTC", "ExecMainStartTimestampMonotonic": "14416181", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:29:40 UTC] ; stop_time=[n/a] ; pid=2419 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:29:40 UTC", "InactiveExitTimestampMonotonic": "14416223", "InvocationID": "3d87d5fdc9024d6b839dc34c32c93575", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:33:29.138 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2419", "MemoryAccounting": "yes", "MemoryCurrent": "1077248", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:33:29.139 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:29:40 UTC", "StateChangeTimestampMonotonic": "14416223", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:29:40 UTC", "WatchdogTimestampMonotonic": "14416222", "WatchdogUSec": "0"}} 2020-04-02T23:33:29.174 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.142) 0:00:29.808 ******** 2020-04-02T23:33:29.232 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:33:29.233 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:33:29.277 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.102) 0:00:29.911 ******** 2020-04-02T23:33:29.373 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:33:29.373 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001702", "end": "2020-04-02 23:33:29.347269", "rc": 0, "start": "2020-04-02 23:33:29.345567", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:33:29.414 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.136) 0:00:30.048 ******** 2020-04-02T23:33:29.527 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi190.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:33:29.574 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.160) 0:00:30.208 ******** 2020-04-02T23:33:29.611 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:33:29.613 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:33:29.648 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:29 +0000 (0:00:00.073) 0:00:30.282 ******** 2020-04-02T23:33:30.138 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-02T23:33:30.140 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:33:30.184 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:30 +0000 (0:00:00.535) 0:00:30.818 ******** 2020-04-02T23:33:30.325 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-02T23:33:30.326 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:33:30.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:30 +0000 (0:00:00.181) 0:00:30.999 ******** 2020-04-02T23:33:30.492 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:33:30.496 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:32:16 UTC", "ActiveEnterTimestampMonotonic": "12312222", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount time-sync.target system.slice nss-lookup.target sysinit.target local-fs.target network.target systemd-journald.socket basic.target tmp.mount -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:32:16 UTC", "AssertTimestampMonotonic": "12311329", "Before": "multi-user.target shutdown.target getty@tty1.service plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:32:16 UTC", "ConditionTimestampMonotonic": "12311328", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:33:30.497 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2392", "ExecMainStartTimestamp": "Thu 2020-04-02 23:32:16 UTC", "ExecMainStartTimestampMonotonic": "12312192", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:32:16 UTC] ; stop_time=[n/a] ; pid=2392 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:32:16 UTC", "InactiveExitTimestampMonotonic": "12312222", "InvocationID": "6119c9f2001741799a19dd7cb8d0c709", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:33:30.499 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127437", "LimitNPROCSoft": "127437", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127437", "LimitSIGPENDINGSoft": "127437", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2392", "MemoryAccounting": "yes", "MemoryCurrent": "1712128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:33:30.500 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:32:16 UTC", "StateChangeTimestampMonotonic": "12312222", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:32:16 UTC", "WatchdogTimestampMonotonic": "12312221", "WatchdogUSec": "0"}} 2020-04-02T23:33:30.552 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:30 +0000 (0:00:00.186) 0:00:31.186 ******** 2020-04-02T23:33:30.749 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:33:30.751 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001677", "end": "2020-04-02 23:33:30.723598", "rc": 0, "start": "2020-04-02 23:33:30.721921", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:33:30.787 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:30 +0000 (0:00:00.234) 0:00:31.421 ******** 2020-04-02T23:33:31.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-02T23:33:31.251 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:33:31.289 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:31 +0000 (0:00:00.502) 0:00:31.923 ******** 2020-04-02T23:33:31.677 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-02T23:33:31.678 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:33:31.741 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:31 +0000 (0:00:00.452) 0:00:32.375 ******** 2020-04-02T23:33:32.607 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-02T23:33:32.609 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:33:32.647 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:32 +0000 (0:00:00.905) 0:00:33.281 ******** 2020-04-02T23:33:32.653 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-02T23:33:32.653 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:33:32.697 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:32 +0000 (0:00:00.050) 0:00:33.331 ******** 2020-04-02T23:33:34.032 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:33:34.071 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:34 +0000 (0:00:01.373) 0:00:34.705 ******** 2020-04-02T23:33:48.984 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-02T23:33:48.986 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.137308", "end": "2020-04-02 23:33:48.956487", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:33:32.819179", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:33:49.021 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:49 +0000 (0:00:14.950) 0:00:49.655 ******** 2020-04-02T23:33:49.488 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:33:49.489 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:33:49.528 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:49 +0000 (0:00:00.504) 0:00:50.160 ******** 2020-04-02T23:33:49.734 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-02T23:33:49.735 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018927", "end": "2020-04-02 23:33:49.716502", "rc": 0, "start": "2020-04-02 23:33:49.697575", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:33:49.774 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:49 +0000 (0:00:00.246) 0:00:50.406 ******** 2020-04-02T23:33:49.962 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-02T23:33:49.964 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002181", "end": "2020-04-02 23:33:49.942997", "rc": 0, "start": "2020-04-02 23:33:49.940816", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:33:50.000 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:49 +0000 (0:00:00.228) 0:00:50.634 ******** 2020-04-02T23:33:50.430 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-02T23:33:50.430 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.159905", "end": "2020-04-02 23:33:50.407648", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:33:34.247743", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:33:50.475 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:50 +0000 (0:00:00.475) 0:00:51.109 ******** 2020-04-02T23:33:50.945 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:33:50.946 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:33:50.986 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:50 +0000 (0:00:00.510) 0:00:51.620 ******** 2020-04-02T23:33:51.214 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-02T23:33:51.216 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.030071", "end": "2020-04-02 23:33:51.187239", "rc": 0, "start": "2020-04-02 23:33:51.157168", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:33:51.257 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:51 +0000 (0:00:00.271) 0:00:51.891 ******** 2020-04-02T23:33:51.463 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002052", "end": "2020-04-02 23:33:51.431584", "rc": 0, "start": "2020-04-02 23:33:51.429532", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:33:51.492 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:33:51 +0000 (0:00:00.234) 0:00:52.126 ******** 2020-04-02T23:34:06.181 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.981107", "end": "2020-04-02 23:34:06.154821", "rc": 0, "start": "2020-04-02 23:33:50.173714", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:06.232 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:14.740) 0:01:06.866 ******** 2020-04-02T23:34:06.438 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-02T23:34:06.439 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:34:06.489 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:00.257) 0:01:07.124 ******** 2020-04-02T23:34:06.518 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:34:06.519 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:34:06.562 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:00.072) 0:01:07.196 ******** 2020-04-02T23:34:06.599 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:34:06.600 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:34:06.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:00.074) 0:01:07.270 ******** 2020-04-02T23:34:06.674 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:34:06.675 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:34:06.719 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:00.082) 0:01:07.353 ******** 2020-04-02T23:34:06.756 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:34:06.758 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:34:06.795 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:06 +0000 (0:00:00.075) 0:01:07.429 ******** 2020-04-02T23:34:06.999 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:34:07.000 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:34:07.042 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.247) 0:01:07.676 ******** 2020-04-02T23:34:07.249 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:34:07.296 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.254) 0:01:07.930 ******** 2020-04-02T23:34:07.332 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:34:07.333 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:07.372 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.075) 0:01:08.006 ******** 2020-04-02T23:34:07.399 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:34:07.410 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:07.450 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.077) 0:01:08.084 ******** 2020-04-02T23:34:07.732 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:34:07.734 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:34:07.774 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.323) 0:01:08.408 ******** 2020-04-02T23:34:07.783 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:34:07.786 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.096233", "end": "2020-04-02 23:34:07.759850", "rc": 0, "start": "2020-04-02 23:33:51.663617", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:07.825 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:07 +0000 (0:00:00.051) 0:01:08.459 ******** 2020-04-02T23:34:08.040 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:34:08.080 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.254) 0:01:08.714 ******** 2020-04-02T23:34:08.119 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:34:08.120 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:34:08.161 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.081) 0:01:08.795 ******** 2020-04-02T23:34:08.208 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:34:08.210 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:34:08.260 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.094) 0:01:08.890 ******** 2020-04-02T23:34:08.306 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:34:08.307 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:34:08.345 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.089) 0:01:08.979 ******** 2020-04-02T23:34:08.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-02T23:34:08.363 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:34:08.408 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.063) 0:01:09.042 ******** 2020-04-02T23:34:08.415 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:34:08.417 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:34:08.489 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.080) 0:01:09.123 ******** 2020-04-02T23:34:08.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:34:08.496 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi078"}, "changed": false} 2020-04-02T23:34:08.537 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.047) 0:01:09.171 ******** 2020-04-02T23:34:08.706 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:34:08.708 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:34:08.758 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.221) 0:01:09.392 ******** 2020-04-02T23:34:08.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:34:08.962 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:34:09.002 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:08 +0000 (0:00:00.243) 0:01:09.636 ******** 2020-04-02T23:34:09.028 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:34:09.030 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:09.068 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:09 +0000 (0:00:00.065) 0:01:09.702 ******** 2020-04-02T23:34:09.095 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:34:09.095 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:09.134 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:09 +0000 (0:00:00.066) 0:01:09.768 ******** 2020-04-02T23:34:09.363 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi190.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:34:09.414 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:09 +0000 (0:00:00.280) 0:01:10.048 ******** 2020-04-02T23:34:09.589 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:34:09.591 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi078", "ansible_hostname": "smithi078", "ansible_nodename": "smithi078"}, "changed": false, "name": "smithi078"} 2020-04-02T23:34:09.639 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:09 +0000 (0:00:00.224) 0:01:10.273 ******** 2020-04-02T23:34:09.995 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:34:10.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:10 +0000 (0:00:00.408) 0:01:10.681 ******** 2020-04-02T23:34:10.075 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:34:10.077 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi190"}, "changed": false} 2020-04-02T23:34:10.132 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:10 +0000 (0:00:00.085) 0:01:10.766 ******** 2020-04-02T23:34:10.142 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-02T23:34:10.144 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:34:10.190 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:10 +0000 (0:00:00.056) 0:01:10.823 ******** 2020-04-02T23:34:10.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:34:10.649 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:34:10.685 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:10 +0000 (0:00:00.495) 0:01:11.319 ******** 2020-04-02T23:34:10.719 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:34:10.721 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi190.front.sepia.ceph.com", "ansible_hostname": "smithi190", "ansible_nodename": "smithi190"}, "changed": true, "name": "smithi190"} 2020-04-02T23:34:10.768 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:10 +0000 (0:00:00.082) 0:01:11.402 ******** 2020-04-02T23:34:11.253 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-02T23:34:11.254 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:34:11.312 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:11 +0000 (0:00:00.542) 0:01:11.944 ******** 2020-04-02T23:34:11.316 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-02T23:34:11.317 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:34:11.355 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:11 +0000 (0:00:00.044) 0:01:11.989 ******** 2020-04-02T23:34:11.783 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:34:11.784 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:34:11.847 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:11 +0000 (0:00:00.492) 0:01:12.481 ******** 2020-04-02T23:34:11.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:34:11.853 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:34:11.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:11 +0000 (0:00:00.045) 0:01:12.527 ******** 2020-04-02T23:34:12.113 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:34:12.114 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:34:12.165 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:12 +0000 (0:00:00.271) 0:01:12.799 ******** 2020-04-02T23:34:12.376 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:34:12.378 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:34:12.412 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:12 +0000 (0:00:00.247) 0:01:13.046 ******** 2020-04-02T23:34:12.450 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-02T23:34:12.451 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:34:12.493 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:12 +0000 (0:00:00.080) 0:01:13.127 ******** 2020-04-02T23:34:12.653 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:34:12.654 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:34:12.726 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:12 +0000 (0:00:00.232) 0:01:13.360 ******** 2020-04-02T23:34:12.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:34:12.993 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:34:13.040 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.313) 0:01:13.674 ******** 2020-04-02T23:34:13.206 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:34:13.206 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:34:13.259 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.219) 0:01:13.893 ******** 2020-04-02T23:34:13.266 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:34:13.266 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:34:13.308 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.048) 0:01:13.942 ******** 2020-04-02T23:34:13.309 INFO:teuthology.task.ansible.out: 2020-04-02T23:34:13.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:34:13.519 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:34:13.560 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.252) 0:01:14.194 ******** 2020-04-02T23:34:13.732 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:34:13.733 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:34:13.778 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.217) 0:01:14.412 ******** 2020-04-02T23:34:13.785 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:34:13.786 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:34:13.840 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:13 +0000 (0:00:00.062) 0:01:14.474 ******** 2020-04-02T23:34:14.366 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:34:14.369 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:34:14.411 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:14 +0000 (0:00:00.571) 0:01:15.045 ******** 2020-04-02T23:34:14.920 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:34:14.920 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:34:14.957 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:14 +0000 (0:00:00.545) 0:01:15.591 ******** 2020-04-02T23:34:15.604 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:34:15.605 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.626232", "end": "2020-04-02 23:34:15.575799", "rc": 0, "start": "2020-04-02 23:34:13.949567", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:15.642 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:15 +0000 (0:00:00.685) 0:01:16.276 ******** 2020-04-02T23:34:16.163 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi078.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:34:16.733 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.572842", "end": "2020-04-02 23:34:16.706207", "rc": 0, "start": "2020-04-02 23:34:15.133365", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:16.779 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:16 +0000 (0:00:01.136) 0:01:17.413 ******** 2020-04-02T23:34:16.870 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:34:16.874 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:34:17.315 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:34:17.326 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:34:17.367 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:17 +0000 (0:00:00.588) 0:01:18.001 ******** 2020-04-02T23:34:17.771 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:34:17.858 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:34:17.859 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:34:17.908 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:17 +0000 (0:00:00.540) 0:01:18.542 ******** 2020-04-02T23:34:18.230 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:34:18.231 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:34:18.278 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:18 +0000 (0:00:00.369) 0:01:18.912 ******** 2020-04-02T23:34:18.413 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:34:18.784 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:34:18.785 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:34:18.823 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:18 +0000 (0:00:00.545) 0:01:19.457 ******** 2020-04-02T23:34:18.890 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:34:18.891 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:34:19.304 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:34:19.358 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:34:19.400 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:19 +0000 (0:00:00.577) 0:01:20.034 ******** 2020-04-02T23:34:19.779 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:34:19.922 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:34:19.923 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.317788", "end": "2020-04-02 23:34:19.900462", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:34:19.582674", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:34:19.924 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-02T23:34:19.963 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:19 +0000 (0:00:00.560) 0:01:20.594 ******** 2020-04-02T23:34:19.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-02T23:34:19.988 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.028 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.067) 0:01:20.662 ******** 2020-04-02T23:34:20.076 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi078.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.077 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.117 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.088) 0:01:20.751 ******** 2020-04-02T23:34:20.155 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:34:20.156 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.192 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.075) 0:01:20.826 ******** 2020-04-02T23:34:20.229 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:34:20.231 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:34:20.232 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi190.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:34:20.274 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.081) 0:01:20.908 ******** 2020-04-02T23:34:20.306 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.032) 0:01:20.941 ******** 2020-04-02T23:34:20.311 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:34:20.311 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.350 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.043) 0:01:20.984 ******** 2020-04-02T23:34:20.398 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:34:20.400 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.437 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.087) 0:01:21.071 ******** 2020-04-02T23:34:20.656 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:34:20.657 INFO:teuthology.task.ansible.out:fatal: [smithi078.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006561", "end": "2020-04-02 23:34:20.632307", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:34:20.625746", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:34:20.701 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.263) 0:01:21.335 ******** 2020-04-02T23:34:20.729 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:34:20.730 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.771 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.069) 0:01:21.405 ******** 2020-04-02T23:34:20.871 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:34:20.871 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.339652", "end": "2020-04-02 23:34:20.836168", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:34:20.496516", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:34:20.913 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.141) 0:01:21.547 ******** 2020-04-02T23:34:20.940 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:20.989 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:20 +0000 (0:00:00.075) 0:01:21.623 ******** 2020-04-02T23:34:21.033 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi190.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.042 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.100 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.110) 0:01:21.734 ******** 2020-04-02T23:34:21.129 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:34:21.131 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.081) 0:01:21.815 ******** 2020-04-02T23:34:21.224 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:34:21.266 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.085) 0:01:21.900 ******** 2020-04-02T23:34:21.319 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:34:21.320 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.356 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.089) 0:01:21.990 ******** 2020-04-02T23:34:21.393 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:34:21.394 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.430 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.074) 0:01:22.064 ******** 2020-04-02T23:34:21.645 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:34:21.646 INFO:teuthology.task.ansible.out:fatal: [smithi190.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006658", "end": "2020-04-02 23:34:21.622292", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:34:21.615634", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:34:21.684 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.253) 0:01:22.318 ******** 2020-04-02T23:34:21.721 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:34:21.722 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:21.759 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:21 +0000 (0:00:00.075) 0:01:22.393 ******** 2020-04-02T23:34:22.952 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:34:22.952 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:34:22.990 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:22 +0000 (0:00:01.231) 0:01:23.625 ******** 2020-04-02T23:34:23.998 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:34:24.039 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:24 +0000 (0:00:01.048) 0:01:24.673 ******** 2020-04-02T23:34:26.122 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:34:26.122 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:34:26.164 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:26 +0000 (0:00:02.120) 0:01:26.794 ******** 2020-04-02T23:34:26.900 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:34:26.940 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:26 +0000 (0:00:00.780) 0:01:27.574 ******** 2020-04-02T23:34:31.084 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-02T23:34:31.085 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.705240", "end": "2020-04-02 23:34:31.061084", "rc": 0, "start": "2020-04-02 23:34:26.355844", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 140 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 122 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 48 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 74 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:34:26 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:34:31.087 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 140 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 122 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 48 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 74 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:34:26 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:34:31.130 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:31 +0000 (0:00:04.189) 0:01:31.764 ******** 2020-04-02T23:34:31.912 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.752109", "end": "2020-04-02 23:34:31.885413", "rc": 0, "start": "2020-04-02 23:34:27.133304", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 145 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 99 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 147 kB/s | 4.7 kB 00:00 \nlab-extras 1.4 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:34:27 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:34:31.914 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 145 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 99 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 147 kB/s | 4.7 kB 00:00 ", "lab-extras 1.4 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:34:27 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:34:31.976 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:31 +0000 (0:00:00.845) 0:01:32.610 ******** 2020-04-02T23:34:38.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:34:38.759 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:34:38.801 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:38 +0000 (0:00:06.822) 0:01:39.432 ******** 2020-04-02T23:34:38.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:34:38.837 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:38.874 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:38 +0000 (0:00:00.075) 0:01:39.508 ******** 2020-04-02T23:34:39.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:34:39.421 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:39 +0000 (0:00:00.541) 0:01:40.050 ******** 2020-04-02T23:34:39.453 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:34:39.455 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:39.504 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:39 +0000 (0:00:00.087) 0:01:40.138 ******** 2020-04-02T23:34:39.779 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:34:39.779 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:34:39.829 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:39 +0000 (0:00:00.325) 0:01:40.464 ******** 2020-04-02T23:34:39.867 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:34:39.868 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:39.909 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:39 +0000 (0:00:00.079) 0:01:40.543 ******** 2020-04-02T23:34:40.229 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:34:40.231 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service polkit.service basic.target dbus.socket system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ip6tables.service iptables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:34:40.232 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", 2020-04-02T23:34:40.236 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:34:40.238 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:34:40.269 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:40 +0000 (0:00:00.359) 0:01:40.903 ******** 2020-04-02T23:34:40.416 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:34:40.417 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:34:40.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:40 +0000 (0:00:00.186) 0:01:41.089 ******** 2020-04-02T23:34:40.503 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:40.542 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:40 +0000 (0:00:00.087) 0:01:41.176 ******** 2020-04-02T23:34:40.577 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi078.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:34:40.620 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:40 +0000 (0:00:00.077) 0:01:41.254 ******** 2020-04-02T23:34:40.889 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:34:40.891 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service polkit.service basic.target system.slice sysinit.target dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service ip6tables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:34:40.893 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127437", "LimitNPROCSoft": "127437", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127437", 2020-04-02T23:34:40.894 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127437", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:34:40.896 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:34:40.936 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:40 +0000 (0:00:00.315) 0:01:41.569 ******** 2020-04-02T23:34:41.232 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:34:41.234 INFO:teuthology.task.ansible.out:fatal: [smithi190.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:34:41.270 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.334) 0:01:41.904 ******** 2020-04-02T23:34:41.341 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:34:41.379 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.108) 0:01:42.013 ******** 2020-04-02T23:34:41.412 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.450 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.071) 0:01:42.084 ******** 2020-04-02T23:34:41.477 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:34:41.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.063) 0:01:42.147 ******** 2020-04-02T23:34:41.540 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-02T23:34:41.541 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.577 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.063) 0:01:42.211 ******** 2020-04-02T23:34:41.583 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:34:41.583 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:34:41.629 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.051) 0:01:42.263 ******** 2020-04-02T23:34:41.638 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:34:41.640 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.681 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.052) 0:01:42.315 ******** 2020-04-02T23:34:41.688 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-02T23:34:41.689 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.729 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.047) 0:01:42.363 ******** 2020-04-02T23:34:41.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:34:41.735 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.736 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.794 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.065) 0:01:42.428 ******** 2020-04-02T23:34:41.801 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:34:41.840 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.045) 0:01:42.474 ******** 2020-04-02T23:34:41.845 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:34:41.847 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.885 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.045) 0:01:42.519 ******** 2020-04-02T23:34:41.892 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-02T23:34:41.894 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:41.939 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.046) 0:01:42.565 ******** TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:34:41.974 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:41 +0000 (0:00:00.042) 0:01:42.608 ******** 2020-04-02T23:34:41.982 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:34:41.984 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.020 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.045) 0:01:42.654 ******** 2020-04-02T23:34:42.028 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.068 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.048) 0:01:42.702 ******** 2020-04-02T23:34:42.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:34:42.077 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.109 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.041) 0:01:42.743 ******** 2020-04-02T23:34:42.114 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:34:42.116 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.154 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.044) 0:01:42.788 ******** 2020-04-02T23:34:42.159 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:34:42.161 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.198 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.044) 0:01:42.832 ******** 2020-04-02T23:34:42.204 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:34:42.205 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.247 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.048) 0:01:42.881 ******** 2020-04-02T23:34:42.252 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:34:42.291 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.044) 0:01:42.925 ******** 2020-04-02T23:34:42.297 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:34:42.299 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.339 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.047) 0:01:42.973 ******** 2020-04-02T23:34:42.344 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:34:42.345 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.382 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.043) 0:01:43.017 ******** 2020-04-02T23:34:42.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:34:42.388 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.426 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.043) 0:01:43.060 ******** 2020-04-02T23:34:42.431 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:34:42.432 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.472 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.046) 0:01:43.107 ******** 2020-04-02T23:34:42.478 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:34:42.479 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.524 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.051) 0:01:43.158 ******** 2020-04-02T23:34:42.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:34:42.531 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.046) 0:01:43.205 ******** 2020-04-02T23:34:42.578 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:34:42.579 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.634 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.062) 0:01:43.268 ******** 2020-04-02T23:34:42.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:34:42.645 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.682 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.048) 0:01:43.316 ******** 2020-04-02T23:34:42.688 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:34:42.688 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.727 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.045) 0:01:43.361 ******** 2020-04-02T23:34:42.733 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:34:42.733 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.778 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.050) 0:01:43.412 ******** 2020-04-02T23:34:42.783 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:34:42.784 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.833 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.048) 0:01:43.460 ******** 2020-04-02T23:34:42.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:34:42.836 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.900 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.073) 0:01:43.534 ******** 2020-04-02T23:34:42.909 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:34:42.910 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.957 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.050) 0:01:43.585 ******** TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:34:42.959 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:42.998 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:42 +0000 (0:00:00.046) 0:01:43.632 ******** 2020-04-02T23:34:43.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:34:43.007 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:43.677 ******** 2020-04-02T23:34:43.049 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:34:43.049 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.089 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:43.723 ******** 2020-04-02T23:34:43.094 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:34:43.097 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.137 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.046) 0:01:43.769 ******** 2020-04-02T23:34:43.141 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:34:43.143 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:43.815 ******** 2020-04-02T23:34:43.188 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:43.860 ******** 2020-04-02T23:34:43.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:34:43.233 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.271 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:43.905 ******** 2020-04-02T23:34:43.276 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:34:43.276 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.315 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.043) 0:01:43.949 ******** 2020-04-02T23:34:43.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:34:43.324 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.363 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.047) 0:01:43.997 ******** 2020-04-02T23:34:43.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:34:43.370 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.407 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.041 ******** 2020-04-02T23:34:43.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:34:43.414 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.454 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.086 ******** 2020-04-02T23:34:43.457 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:34:43.458 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.500 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.048) 0:01:44.135 ******** 2020-04-02T23:34:43.509 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.546 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.045) 0:01:44.180 ******** 2020-04-02T23:34:43.552 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:34:43.553 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.597 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.047) 0:01:44.227 ******** 2020-04-02T23:34:43.599 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:34:43.601 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.637 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.043) 0:01:44.271 ******** 2020-04-02T23:34:43.642 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:34:43.643 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.681 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.043) 0:01:44.315 ******** 2020-04-02T23:34:43.687 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:34:43.689 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.725 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.360 ******** 2020-04-02T23:34:43.733 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:34:43.734 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.772 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.046) 0:01:44.406 ******** 2020-04-02T23:34:43.779 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:34:43.780 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.046) 0:01:44.452 ******** 2020-04-02T23:34:43.823 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:34:43.825 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.868 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.049) 0:01:44.502 ******** 2020-04-02T23:34:43.875 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.912 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.546 ******** 2020-04-02T23:34:43.917 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:34:43.917 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:43.956 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.590 ******** 2020-04-02T23:34:43.962 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:34:43.963 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.001 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:43 +0000 (0:00:00.044) 0:01:44.635 ******** 2020-04-02T23:34:44.006 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:34:44.008 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.044 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:44.678 ******** 2020-04-02T23:34:44.051 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.090 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.045) 0:01:44.724 ******** 2020-04-02T23:34:44.095 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:34:44.095 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.133 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:44.767 ******** 2020-04-02T23:34:44.145 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.182 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:44.811 ******** 2020-04-02T23:34:44.183 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.219 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.042) 0:01:44.853 ******** 2020-04-02T23:34:44.225 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:34:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.262 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:44.896 ******** 2020-04-02T23:34:44.267 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:34:44.268 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.306 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.042) 0:01:44.939 ******** 2020-04-02T23:34:44.310 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:34:44.312 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.348 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.042) 0:01:44.982 ******** 2020-04-02T23:34:44.361 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.393 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.044) 0:01:45.027 ******** 2020-04-02T23:34:44.401 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.437 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:45.071 ******** 2020-04-02T23:34:44.442 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:34:44.442 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.481 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.044) 0:01:45.115 ******** 2020-04-02T23:34:44.487 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:34:44.488 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.525 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:45.159 ******** 2020-04-02T23:34:44.551 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:34:44.552 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.588 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.063) 0:01:45.222 ******** 2020-04-02T23:34:44.615 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:34:44.617 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.065) 0:01:45.287 ******** 2020-04-02T23:34:44.679 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:34:44.680 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:44.716 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.063) 0:01:45.351 ******** 2020-04-02T23:34:44.722 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:34:44.722 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:34:44.760 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.043) 0:01:45.394 ******** 2020-04-02T23:34:44.933 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:34:44.972 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:44 +0000 (0:00:00.211) 0:01:45.606 ******** 2020-04-02T23:34:44.977 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:34:44.980 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:34:45.016 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.044) 0:01:45.650 ******** 2020-04-02T23:34:45.179 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:34:45.219 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.203) 0:01:45.853 ******** 2020-04-02T23:34:45.225 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:45.226 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2020-04-02T23:34:45.227 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:34:45.267 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.047) 0:01:45.901 ******** 2020-04-02T23:34:45.294 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.330 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.062) 0:01:45.964 ******** 2020-04-02T23:34:45.356 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:34:45.358 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.394 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.063) 0:01:46.028 ******** 2020-04-02T23:34:45.431 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:45.431 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:34:45.441 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.481 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.080) 0:01:46.108 ******** 2020-04-02T23:34:45.509 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.033) 0:01:46.142 ******** 2020-04-02T23:34:45.513 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:34:45.514 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.551 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.043) 0:01:46.185 ******** 2020-04-02T23:34:45.557 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:34:45.559 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.595 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.043) 0:01:46.229 ******** 2020-04-02T23:34:45.599 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:34:45.600 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.640 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.044) 0:01:46.274 ******** 2020-04-02T23:34:45.646 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:34:45.647 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.684 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.044) 0:01:46.318 ******** 2020-04-02T23:34:45.688 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:45.689 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.727 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.043) 0:01:46.361 ******** 2020-04-02T23:34:45.731 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:34:45.733 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.778 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.042) 0:01:46.404 ******** TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.815 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.045) 0:01:46.449 ******** 2020-04-02T23:34:45.821 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:34:45.822 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.859 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.044) 0:01:46.493 ******** 2020-04-02T23:34:45.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:34:45.865 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.904 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.044) 0:01:46.538 ******** 2020-04-02T23:34:45.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:34:45.911 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.948 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.043) 0:01:46.582 ******** 2020-04-02T23:34:45.953 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:45.955 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:45.992 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:45 +0000 (0:00:00.043) 0:01:46.626 ******** 2020-04-02T23:34:45.999 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:46.000 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.036 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:46.670 ******** 2020-04-02T23:34:46.041 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-02T23:34:46.041 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.079 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:46.714 ******** 2020-04-02T23:34:46.084 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:34:46.085 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.124 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.044) 0:01:46.758 ******** 2020-04-02T23:34:46.129 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:34:46.131 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.167 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:46.802 ******** 2020-04-02T23:34:46.173 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:34:46.174 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.212 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.044) 0:01:46.846 ******** 2020-04-02T23:34:46.216 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:34:46.217 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.257 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.045) 0:01:46.891 ******** 2020-04-02T23:34:46.262 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:34:46.264 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.301 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:46.935 ******** 2020-04-02T23:34:46.306 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:34:46.308 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.344 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:46.978 ******** 2020-04-02T23:34:46.351 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.388 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:47.022 ******** 2020-04-02T23:34:46.392 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:34:46.394 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.432 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.043) 0:01:47.066 ******** 2020-04-02T23:34:46.438 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:34:46.438 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.477 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.045) 0:01:47.111 ******** 2020-04-02T23:34:46.482 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:34:46.484 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.521 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.044) 0:01:47.156 ******** 2020-04-02T23:34:46.529 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:34:46.530 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.049) 0:01:47.205 ******** 2020-04-02T23:34:46.576 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:34:46.578 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.615 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.044) 0:01:47.249 ******** 2020-04-02T23:34:46.623 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:34:46.625 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.663 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.047) 0:01:47.297 ******** 2020-04-02T23:34:46.671 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.710 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.044) 0:01:47.342 ******** 2020-04-02T23:34:46.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:34:46.715 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.760 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.052) 0:01:47.394 ******** 2020-04-02T23:34:46.766 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:34:46.768 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.046) 0:01:47.441 ******** 2020-04-02T23:34:46.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:34:46.814 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.853 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.045) 0:01:47.487 ******** 2020-04-02T23:34:46.861 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.899 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.046) 0:01:47.533 ******** 2020-04-02T23:34:46.906 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:34:46.908 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:46.945 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.046) 0:01:47.579 ******** 2020-04-02T23:34:46.951 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:34:46.952 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.007 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:46 +0000 (0:00:00.047) 0:01:47.627 ******** TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.039 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.045) 0:01:47.673 ******** 2020-04-02T23:34:47.044 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-02T23:34:47.045 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.084 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.045) 0:01:47.718 ******** 2020-04-02T23:34:47.090 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:34:47.093 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.131 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.046) 0:01:47.765 ******** 2020-04-02T23:34:47.137 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:34:47.137 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.177 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.045) 0:01:47.811 ******** 2020-04-02T23:34:47.183 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:34:47.185 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.049) 0:01:47.860 ******** 2020-04-02T23:34:47.232 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:34:47.232 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:34:47.275 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.048) 0:01:47.909 ******** 2020-04-02T23:34:47.281 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:34:47.282 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.049) 0:01:47.958 ******** 2020-04-02T23:34:47.330 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:34:47.331 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.343 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:34:47.344 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.389 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.063) 0:01:48.021 ******** 2020-04-02T23:34:47.393 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:34:47.393 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.395 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.395 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.396 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.442 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.054) 0:01:48.076 ******** 2020-04-02T23:34:47.448 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:34:47.448 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.491 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.049) 0:01:48.125 ******** 2020-04-02T23:34:47.528 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:34:47.530 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:34:47.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.079) 0:01:48.205 ******** 2020-04-02T23:34:47.587 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-02T23:34:47.589 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003418", "end": "2020-04-02 23:34:47.564557", "rc": 0, "start": "2020-04-02 23:34:47.561139", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:34:47.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.064) 0:01:48.270 ******** 2020-04-02T23:34:47.642 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:34:47.642 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.644 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:34:47.644 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.645 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.656 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.658 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.669 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:34:47.670 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi190.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.077) 0:01:48.348 ******** 2020-04-02T23:34:47.756 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.042) 0:01:48.390 ******** 2020-04-02T23:34:47.760 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:34:47.761 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.050) 0:01:48.441 ******** 2020-04-02T23:34:47.836 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:34:47.838 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.873 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.065) 0:01:48.506 ******** 2020-04-02T23:34:47.893 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi190.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003220", "end": "2020-04-02 23:34:47.870713", "rc": 0, "start": "2020-04-02 23:34:47.867493", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:34:47.930 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.058) 0:01:48.564 ******** 2020-04-02T23:34:47.936 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:34:47.938 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:47.974 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:47 +0000 (0:00:00.044) 0:01:48.608 ******** 2020-04-02T23:34:47.980 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:34:47.981 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:48.022 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:48 +0000 (0:00:00.047) 0:01:48.656 ******** 2020-04-02T23:34:48.047 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:34:48.049 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:48.086 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:48 +0000 (0:00:00.064) 0:01:48.720 ******** 2020-04-02T23:34:48.123 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:34:48.124 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:48.167 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:48 +0000 (0:00:00.081) 0:01:48.801 ******** 2020-04-02T23:34:48.193 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:34:48.195 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:48.232 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:48 +0000 (0:00:00.065) 0:01:48.866 ******** 2020-04-02T23:34:48.885 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-02T23:34:48.886 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:34:48.927 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:48 +0000 (0:00:00.694) 0:01:49.561 ******** 2020-04-02T23:34:48.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi078.front.sepia.ceph.com] => (item={u'block_used': 12908088, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227187020, u'size_available': 930558033920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990062, u'device': u'/dev/sda1', u'inode_used': 64914, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227187020, "block_size": 4096, "block_total": 240095108, "block_used": 12908088, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990062, "inode_total": 61054976, "inode_used": 64914, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930558033920, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:34:49.008 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.080) 0:01:49.642 ******** 2020-04-02T23:34:49.161 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:34:49.230 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.222) 0:01:49.864 ******** 2020-04-02T23:34:49.241 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004984", "end": "2020-04-02 23:34:49.187907", "rc": 0, "start": "2020-04-02 23:34:49.182923", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:49.292 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.062) 0:01:49.927 ******** 2020-04-02T23:34:49.298 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:34:49.299 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item={u'block_used': 12911788, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183320, u'size_available': 930542878720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183320, "block_size": 4096, "block_total": 240095108, "block_used": 12911788, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542878720, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:34:49.344 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.051) 0:01:49.978 ******** 2020-04-02T23:34:49.350 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:34:49.351 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'block_used': 12908088, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227187020, u'size_available': 930558033920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990062, u'device': u'/dev/sda1', u'inode_used': 64914, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227187020, "block_size": 4096, "block_total": 240095108, "block_used": 12908088, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990062, "inode_total": 61054976, "inode_used": 64914, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930558033920, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:49.392 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.048) 0:01:50.026 ******** 2020-04-02T23:34:49.423 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:34:49.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.065) 0:01:50.092 ******** 2020-04-02T23:34:49.505 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:34:49.506 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGR8', u'wwn-0x5000c500918e79d4'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LGR8', u'wwn': u'0x5000c500918e79d4', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1', u'wwn-0x5000c500918e79d4-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8", "wwn-0x5000c500918e79d4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1", "wwn-0x5000c500918e79d4-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGR8", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:34:49.508 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e79d4"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:49.551 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-02T23:34:49.552 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005048", "end": "2020-04-02 23:34:49.520879", "rc": 0, "start": "2020-04-02 23:34:49.515831", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:49.590 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.131) 0:01:50.224 ******** 2020-04-02T23:34:49.639 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:34:49.640 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'block_used': 12911788, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183320, u'size_available': 930542878720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183320, "block_size": 4096, "block_total": 240095108, "block_used": 12911788, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542878720, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:49.679 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.088) 0:01:50.313 ******** 2020-04-02T23:34:49.705 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:34:49.746 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:49 +0000 (0:00:00.067) 0:01:50.380 ******** 2020-04-02T23:34:49.783 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:34:49.784 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKCA', u'wwn-0x5000c50092937ba8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKCA', u'wwn': u'0x5000c50092937ba8', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKCA-part1', u'wwn-0x5000c50092937ba8-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKCA", "wwn-0x5000c50092937ba8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKCA-part1", "wwn-0x5000c50092937ba8-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKCA", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:34:49.786 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092937ba8"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:51.077 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-mNIf6I-NEKv-oxYb-vt1A-qU1t-zUTF-crMg3u', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN', u'nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.386029", "end": "2020-04-02 23:34:51.048333", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mNIf6I-NEKv-oxYb-vt1A-qU1t-zUTF-crMg3u", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN", "nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:49.662304", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:34:51.079 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:51.501 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gMRd4o-GuhM-OhU3-FJ2N-5Vfo-t4UM-3beLpB', u'nvme-INTEL_SSDPEDMD400G4_CVFT63210012400BGN', u'nvme-nvme.8086-43564654363332313030313234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.521651", "end": "2020-04-02 23:34:51.465449", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gMRd4o-GuhM-OhU3-FJ2N-5Vfo-t4UM-3beLpB", "nvme-INTEL_SSDPEDMD400G4_CVFT63210012400BGN", "nvme-nvme.8086-43564654363332313030313234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:49.943798", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:34:51.503 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:52.321 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhvK6Gxd0D5Lgyh3lAg9mEKOqZhCdqFRC'], u'uuids': [u'8ab903bd-7fc5-4611-940c-7028d11f4ca4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.047496", "end": "2020-04-02 23:34:52.295837", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhvK6Gxd0D5Lgyh3lAg9mEKOqZhCdqFRC"], "labels": [], "masters": [], "uuids": ["8ab903bd-7fc5-4611-940c-7028d11f4ca4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:51.248341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:52.762 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6JDCu153xDRqjQW05eA0pPaxajAaJ7u86'], u'uuids': [u'bad7105c-440f-47f0-b3c1-875edd2cacec']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.051506", "end": "2020-04-02 23:34:52.728159", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6JDCu153xDRqjQW05eA0pPaxajAaJ7u86"], "labels": [], "masters": [], "uuids": ["bad7105c-440f-47f0-b3c1-875edd2cacec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:51.676653", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:53.592 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJ2j5rfXLmltU5HZ2plXpdwrlscD8i2M3M'], u'uuids': [u'254fabd7-3f9f-45e3-afc5-b6794f78f20b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.064655", "end": "2020-04-02 23:34:53.554057", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJ2j5rfXLmltU5HZ2plXpdwrlscD8i2M3M"], "labels": [], "masters": [], "uuids": ["254fabd7-3f9f-45e3-afc5-b6794f78f20b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:52.489402", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:54.003 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6duBOavOVu7t8Hkv2i3vVtk5r8Nyzz2OR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.047520", "end": "2020-04-02 23:34:53.970727", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6duBOavOVu7t8Hkv2i3vVtk5r8Nyzz2OR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:52.923207", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:54.837 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhdn13ycYIjyqhf5p7NciaMshPZhtyNWR'], u'uuids': [u'733013b8-f894-4434-8a40-ff7a69d336b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051460", "end": "2020-04-02 23:34:54.804447", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhdn13ycYIjyqhf5p7NciaMshPZhtyNWR"], "labels": [], "masters": [], "uuids": ["733013b8-f894-4434-8a40-ff7a69d336b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:53.752987", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:55.230 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6H2orPIbtalj388CD5yWw482VFuK83ze9'], u'uuids': [u'70cae383-689d-4668-949d-cae101abea7e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.040889", "end": "2020-04-02 23:34:55.204039", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6H2orPIbtalj388CD5yWw482VFuK83ze9"], "labels": [], "masters": [], "uuids": ["70cae383-689d-4668-949d-cae101abea7e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:54.163150", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:56.083 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJD8jfY7oTR7hEdom2ZsmlYfNSxBec1iva'], u'uuids': [u'85ab2e97-e514-4e8f-b60f-2374b2b3f490']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.046077", "end": "2020-04-02 23:34:56.045400", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJD8jfY7oTR7hEdom2ZsmlYfNSxBec1iva"], "labels": [], "masters": [], "uuids": ["85ab2e97-e514-4e8f-b60f-2374b2b3f490"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:54.999323", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:56.493 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6my1uSYCS43cgvEVudkYfz04T2C4Q8ag0'], u'uuids': [u'91b2cfbf-bbe6-41a8-90ad-3fd3334427fc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.051679", "end": "2020-04-02 23:34:56.455839", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6my1uSYCS43cgvEVudkYfz04T2C4Q8ag0"], "labels": [], "masters": [], "uuids": ["91b2cfbf-bbe6-41a8-90ad-3fd3334427fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:55.404160", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:57.328 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJcVMdOFXs2Dm0YPAkGqtMy3mH0xKfVM2M'], u'uuids': [u'4feb2d03-f657-4d74-b599-1a5ed035e47e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.044124", "end": "2020-04-02 23:34:57.288929", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJcVMdOFXs2Dm0YPAkGqtMy3mH0xKfVM2M"], "labels": [], "masters": [], "uuids": ["4feb2d03-f657-4d74-b599-1a5ed035e47e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:56.244805", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:57.377 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:57 +0000 (0:00:07.630) 0:01:58.011 ******** 2020-04-02T23:34:57.415 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:34:57.416 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGR8', u'wwn-0x5000c500918e79d4'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LGR8', u'wwn': u'0x5000c500918e79d4', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1', u'wwn-0x5000c500918e79d4-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8", "wwn-0x5000c500918e79d4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1", "wwn-0x5000c500918e79d4-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGR8", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:34:57.418 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e79d4"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:57.647 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-mNIf6I-NEKv-oxYb-vt1A-qU1t-zUTF-crMg3u', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN', u'nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037166", "end": "2020-04-02 23:34:57.617494", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mNIf6I-NEKv-oxYb-vt1A-qU1t-zUTF-crMg3u", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN", "nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:57.580328", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:34:57.649 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0345267 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0345267 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:57.750 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6jdgAZdgNi0XFORZlsBs53O1kY42jq1yG'], u'uuids': [u'2a20da94-f95f-4b14-b3fa-d2c9dc1fa3b1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.043758", "end": "2020-04-02 23:34:57.705254", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6jdgAZdgNi0XFORZlsBs53O1kY42jq1yG"], "labels": [], "masters": [], "uuids": ["2a20da94-f95f-4b14-b3fa-d2c9dc1fa3b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:56.661496", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! 2020-04-02T23:34:57.751 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:34:57.785 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:57 +0000 (0:00:00.408) 0:01:58.420 ******** 2020-04-02T23:34:57.823 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:34:57.825 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKCA', u'wwn-0x5000c50092937ba8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XKCA', u'wwn': u'0x5000c50092937ba8', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XKCA-part1', u'wwn-0x5000c50092937ba8-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKCA", "wwn-0x5000c50092937ba8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XKCA-part1", "wwn-0x5000c50092937ba8-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XKCA", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:34:57.826 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092937ba8"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:34:57.991 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhvK6Gxd0D5Lgyh3lAg9mEKOqZhCdqFRC'], u'uuids': [u'8ab903bd-7fc5-4611-940c-7028d11f4ca4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144422", "end": "2020-04-02 23:34:57.950667", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhvK6Gxd0D5Lgyh3lAg9mEKOqZhCdqFRC"], "labels": [], "masters": [], "uuids": ["8ab903bd-7fc5-4611-940c-7028d11f4ca4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:57.806245", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141753 s, 814 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141753 s, 814 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.067 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gMRd4o-GuhM-OhU3-FJ2N-5Vfo-t4UM-3beLpB', u'nvme-INTEL_SSDPEDMD400G4_CVFT63210012400BGN', u'nvme-nvme.8086-43564654363332313030313234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037534", "end": "2020-04-02 23:34:58.028915", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gMRd4o-GuhM-OhU3-FJ2N-5Vfo-t4UM-3beLpB", "nvme-INTEL_SSDPEDMD400G4_CVFT63210012400BGN", "nvme-nvme.8086-43564654363332313030313234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:57.991381", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:34:58.068 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0349352 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349352 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.317 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJ2j5rfXLmltU5HZ2plXpdwrlscD8i2M3M'], u'uuids': [u'254fabd7-3f9f-45e3-afc5-b6794f78f20b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144082", "end": "2020-04-02 23:34:58.278737", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJ2j5rfXLmltU5HZ2plXpdwrlscD8i2M3M"], "labels": [], "masters": [], "uuids": ["254fabd7-3f9f-45e3-afc5-b6794f78f20b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.134655", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141554 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141554 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.392 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6JDCu153xDRqjQW05eA0pPaxajAaJ7u86'], u'uuids': [u'bad7105c-440f-47f0-b3c1-875edd2cacec']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140427", "end": "2020-04-02 23:34:58.364611", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6JDCu153xDRqjQW05eA0pPaxajAaJ7u86"], "labels": [], "masters": [], "uuids": ["bad7105c-440f-47f0-b3c1-875edd2cacec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.224184", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137923 s, 836 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137923 s, 836 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.658 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhdn13ycYIjyqhf5p7NciaMshPZhtyNWR'], u'uuids': [u'733013b8-f894-4434-8a40-ff7a69d336b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.150506", "end": "2020-04-02 23:34:58.634230", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJhdn13ycYIjyqhf5p7NciaMshPZhtyNWR"], "labels": [], "masters": [], "uuids": ["733013b8-f894-4434-8a40-ff7a69d336b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.483724", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147906 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147906 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.723 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6duBOavOVu7t8Hkv2i3vVtk5r8Nyzz2OR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139425", "end": "2020-04-02 23:34:58.693104", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6duBOavOVu7t8Hkv2i3vVtk5r8Nyzz2OR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.553679", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136841 s, 843 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136841 s, 843 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:58.995 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJD8jfY7oTR7hEdom2ZsmlYfNSxBec1iva'], u'uuids': [u'85ab2e97-e514-4e8f-b60f-2374b2b3f490']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.147248", "end": "2020-04-02 23:34:58.964038", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJD8jfY7oTR7hEdom2ZsmlYfNSxBec1iva"], "labels": [], "masters": [], "uuids": ["85ab2e97-e514-4e8f-b60f-2374b2b3f490"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.816790", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144651 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144651 s, 797 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.049 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6H2orPIbtalj388CD5yWw482VFuK83ze9'], u'uuids': [u'70cae383-689d-4668-949d-cae101abea7e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138298", "end": "2020-04-02 23:34:59.014952", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6H2orPIbtalj388CD5yWw482VFuK83ze9"], "labels": [], "masters": [], "uuids": ["70cae383-689d-4668-949d-cae101abea7e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:58.876654", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135849 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135849 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.323 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJcVMdOFXs2Dm0YPAkGqtMy3mH0xKfVM2M'], u'uuids': [u'4feb2d03-f657-4d74-b599-1a5ed035e47e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.142943", "end": "2020-04-02 23:34:59.290476", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6t0C8khC15P3a8vitX2KsL2G5cU840lJcVMdOFXs2Dm0YPAkGqtMy3mH0xKfVM2M"], "labels": [], "masters": [], "uuids": ["4feb2d03-f657-4d74-b599-1a5ed035e47e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:59.147533", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140316 s, 822 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140316 s, 822 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.369 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:59 +0000 (0:00:01.583) 0:02:00.003 ******** 2020-04-02T23:34:59.396 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6my1uSYCS43cgvEVudkYfz04T2C4Q8ag0'], u'uuids': [u'91b2cfbf-bbe6-41a8-90ad-3fd3334427fc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.149200", "end": "2020-04-02 23:34:59.363944", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6my1uSYCS43cgvEVudkYfz04T2C4Q8ag0"], "labels": [], "masters": [], "uuids": ["91b2cfbf-bbe6-41a8-90ad-3fd3334427fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:59.214744", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146667 s, 786 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146667 s, 786 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.628 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-02T23:34:59.630 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.062936", "end": "2020-04-02 23:34:59.599950", "rc": 0, "start": "2020-04-02 23:34:59.537014", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:59 +0000 (0:00:00.296) 0:02:00.299 ******** 2020-04-02T23:34:59.713 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:34:59.714 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6jdgAZdgNi0XFORZlsBs53O1kY42jq1yG'], u'uuids': [u'2a20da94-f95f-4b14-b3fa-d2c9dc1fa3b1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138591", "end": "2020-04-02 23:34:59.682986", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-PXkuoP0iGQwUjISr63FTNopt5b6UMSW6jdgAZdgNi0XFORZlsBs53O1kY42jq1yG"], "labels": [], "masters": [], "uuids": ["2a20da94-f95f-4b14-b3fa-d2c9dc1fa3b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:34:59.544395", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136121 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136121 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.769 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:59 +0000 (0:00:00.103) 0:02:00.403 ******** 2020-04-02T23:34:59.912 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052331", "end": "2020-04-02 23:34:59.888982", "rc": 0, "start": "2020-04-02 23:34:59.836651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:34:59.949 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:34:59 +0000 (0:00:00.179) 0:02:00.583 ******** 2020-04-02T23:34:59.976 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:35:00.018 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.069) 0:02:00.653 ******** 2020-04-02T23:35:00.046 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-02T23:35:00.047 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.076735", "end": "2020-04-02 23:35:00.014687", "rc": 0, "start": "2020-04-02 23:34:59.937952", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:00.085 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.066) 0:02:00.719 ******** 2020-04-02T23:35:00.091 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:35:00.091 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.133 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.047) 0:02:00.767 ******** 2020-04-02T23:35:00.180 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-02T23:35:00.181 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.224 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.091) 0:02:00.858 ******** 2020-04-02T23:35:00.250 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:35:00.252 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.292 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.067) 0:02:00.926 ******** 2020-04-02T23:35:00.329 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:35:00.332 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051168", "end": "2020-04-02 23:35:00.301408", "rc": 0, "start": "2020-04-02 23:35:00.250240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:00.374 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.081) 0:02:01.008 ******** 2020-04-02T23:35:00.413 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.039) 0:02:01.047 ******** 2020-04-02T23:35:00.443 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:35:00.483 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.070) 0:02:01.117 ******** 2020-04-02T23:35:00.509 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:35:00.511 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.550 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.066) 0:02:01.184 ******** 2020-04-02T23:35:00.576 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:35:00.577 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:35:00.578 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.617 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.067) 0:02:01.252 ******** 2020-04-02T23:35:00.652 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.034) 0:02:01.286 ******** 2020-04-02T23:35:00.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:35:00.658 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={u'block_used': 12908088, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227187020, u'size_available': 930558033920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990062, u'device': u'/dev/sda1', u'inode_used': 64914, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227187020, "block_size": 4096, "block_total": 240095108, "block_used": 12908088, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990062, "inode_total": 61054976, "inode_used": 64914, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930558033920, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.698 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.046) 0:02:01.332 ******** 2020-04-02T23:35:00.704 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:35:00.705 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.744 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.045) 0:02:01.378 ******** 2020-04-02T23:35:00.749 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:35:00.749 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.789 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.044) 0:02:01.423 ******** 2020-04-02T23:35:00.795 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:35:00.797 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.833 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.044) 0:02:01.468 ******** 2020-04-02T23:35:00.839 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:35:00.839 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.878 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.044) 0:02:01.512 ******** 2020-04-02T23:35:00.905 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:00.942 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:00 +0000 (0:00:00.064) 0:02:01.576 ******** 2020-04-02T23:35:00.969 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:35:00.970 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.006 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.063) 0:02:01.640 ******** 2020-04-02T23:35:01.023 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:35:01.025 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:35:01.060 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.053) 0:02:01.694 ******** 2020-04-02T23:35:01.073 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.104 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.044) 0:02:01.738 ******** 2020-04-02T23:35:01.110 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:35:01.110 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={u'block_used': 12911788, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183320, u'size_available': 930542878720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183320, "block_size": 4096, "block_total": 240095108, "block_used": 12911788, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542878720, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.150 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.045) 0:02:01.784 ******** 2020-04-02T23:35:01.155 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:35:01.156 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.195 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.044) 0:02:01.829 ******** 2020-04-02T23:35:01.201 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:35:01.201 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.241 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.043) 0:02:01.873 ******** 2020-04-02T23:35:01.275 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:35:01.277 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.074) 0:02:01.947 ******** 2020-04-02T23:35:01.340 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:35:01.341 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.377 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.064) 0:02:02.011 ******** 2020-04-02T23:35:01.414 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:35:01.416 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.451 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.073) 0:02:02.085 ******** 2020-04-02T23:35:01.488 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:35:01.489 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.524 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.073) 0:02:02.158 ******** 2020-04-02T23:35:01.561 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:35:01.562 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:01.609 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.075) 0:02:02.234 ******** 2020-04-02T23:35:01.925 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-02T23:35:01.927 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:35:01.967 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:01 +0000 (0:00:00.366) 0:02:02.601 ******** 2020-04-02T23:35:02.079 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:35:02.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:02 +0000 (0:00:00.169) 0:02:02.770 ******** 2020-04-02T23:35:02.631 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:35:02.633 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:02.677 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:02.963 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:03.017 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:03.361 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:03.393 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:03.736 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:03.790 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:04.085 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:04.149 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:04 +0000 (0:00:02.012) 0:02:04.783 ******** 2020-04-02T23:35:04.155 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:35:04.202 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:04 +0000 (0:00:00.053) 0:02:04.836 ******** 2020-04-02T23:35:04.347 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:35:04.349 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:35:04.388 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:04 +0000 (0:00:00.186) 0:02:05.022 ******** 2020-04-02T23:35:04.408 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:35:04.449 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:04 +0000 (0:00:00.060) 0:02:05.083 ******** 2020-04-02T23:35:04.451 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:04.454 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:35:04.455 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:04.499 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:04.619 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:04.694 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:04.810 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:04.895 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:05.006 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:05.089 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:05.189 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:05.236 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.786) 0:02:05.869 ******** 2020-04-02T23:35:05.295 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:35:05.338 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.102) 0:02:05.972 ******** 2020-04-02T23:35:05.438 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:35:05.439 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:35:05.477 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.139) 0:02:06.111 ******** 2020-04-02T23:35:05.516 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-02T23:35:05.518 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:35:05.566 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.088) 0:02:06.200 ******** 2020-04-02T23:35:05.572 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:35:05.573 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:35:05.615 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.049) 0:02:06.249 ******** 2020-04-02T23:35:05.653 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-02T23:35:05.654 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:35:05.695 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:05 +0000 (0:00:00.077) 0:02:06.327 ******** 2020-04-02T23:35:06.149 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi078.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:35:06.191 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:06 +0000 (0:00:00.497) 0:02:06.824 ******** 2020-04-02T23:35:06.197 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:06.203 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:35:06.244 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:06 +0000 (0:00:00.053) 0:02:06.878 ******** 2020-04-02T23:35:06.832 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:35:06.834 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:35:06.873 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:06 +0000 (0:00:00.629) 0:02:07.507 ******** 2020-04-02T23:35:06.915 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:06 +0000 (0:00:00.041) 0:02:07.549 ******** 2020-04-02T23:35:06.922 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:35:06.922 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:06.969 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:06 +0000 (0:00:00.054) 0:02:07.603 ******** 2020-04-02T23:35:06.979 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.041 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.071) 0:02:07.676 ******** 2020-04-02T23:35:07.047 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-02T23:35:07.048 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.087 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:07.721 ******** 2020-04-02T23:35:07.093 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.135 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.047) 0:02:07.769 ******** 2020-04-02T23:35:07.141 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:35:07.142 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.180 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:07.814 ******** 2020-04-02T23:35:07.186 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:07.860 ******** 2020-04-02T23:35:07.232 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-02T23:35:07.233 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.271 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:07.905 ******** 2020-04-02T23:35:07.277 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.315 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.043) 0:02:07.949 ******** 2020-04-02T23:35:07.323 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-02T23:35:07.325 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.362 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.046) 0:02:07.996 ******** 2020-04-02T23:35:07.372 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.407 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:08.041 ******** 2020-04-02T23:35:07.412 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:35:07.413 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.050) 0:02:08.092 ******** 2020-04-02T23:35:07.464 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.503 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:08.137 ******** 2020-04-02T23:35:07.509 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:35:07.511 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.549 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:08.183 ******** 2020-04-02T23:35:07.557 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.596 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.047) 0:02:08.230 ******** 2020-04-02T23:35:07.602 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:35:07.602 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.643 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.046) 0:02:08.277 ******** 2020-04-02T23:35:07.649 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.689 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.046) 0:02:08.323 ******** 2020-04-02T23:35:07.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:35:07.696 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.734 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:08.369 ******** 2020-04-02T23:35:07.740 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.780 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.045) 0:02:08.414 ******** 2020-04-02T23:35:07.787 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:35:07.789 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.826 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.046) 0:02:08.460 ******** 2020-04-02T23:35:07.832 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.044) 0:02:08.505 ******** 2020-04-02T23:35:07.878 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:35:07.879 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.919 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.048) 0:02:08.553 ******** 2020-04-02T23:35:07.926 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:07.966 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:07 +0000 (0:00:00.046) 0:02:08.600 ******** 2020-04-02T23:35:08.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:35:08.402 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:35:08.444 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.477) 0:02:09.078 ******** 2020-04-02T23:35:08.451 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:35:08.490 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.045) 0:02:09.124 ******** 2020-04-02T23:35:08.745 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:35:08.747 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:29:40 UTC", "ActiveEnterTimestampMonotonic": "14397426", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service sntp.service systemd-journald.socket tmp.mount system.slice -.mount sysinit.target systemd-tmpfiles-setup.service basic.target ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:29:38 UTC", "AssertTimestampMonotonic": "13211794", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:29:38 UTC", "ConditionTimestampMonotonic": "13211665", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:35:08.749 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2354", "ExecMainStartTimestamp": "Thu 2020-04-02 23:29:39 UTC", "ExecMainStartTimestampMonotonic": "14341403", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:29:38 UTC", "InactiveExitTimestampMonotonic": "13262883", "InvocationID": "8566a7698d4f455ba2f4c97bab606ea9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:35:08.750 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2354", "MemoryAccounting": "yes", "MemoryCurrent": "2797568", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:35:08.752 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:29:40 UTC", "StateChangeTimestampMonotonic": "14397426", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:29:39 UTC", "WatchdogTimestampMonotonic": "14341413", "WatchdogUSec": "0"}} 2020-04-02T23:35:08.786 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.296) 0:02:09.420 ******** 2020-04-02T23:35:08.796 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:32:16 UTC", "ActiveEnterTimestampMonotonic": "11858982", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice -.mount sntp.service ntpdate.service systemd-tmpfiles-setup.service tmp.mount basic.target sysinit.target systemd-journald.socket ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:32:15 UTC", "AssertTimestampMonotonic": "10807850", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:32:15 UTC", "ConditionTimestampMonotonic": "10807690", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:35:08.798 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2346", "ExecMainStartTimestamp": "Thu 2020-04-02 23:32:16 UTC", "ExecMainStartTimestampMonotonic": "11770087", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:32:15 UTC", "InactiveExitTimestampMonotonic": "10832383", "InvocationID": "2bf9b048583d48bab67ad24af119786e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:35:08.799 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127437", "LimitNPROCSoft": "127437", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127437", "LimitSIGPENDINGSoft": "127437", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2346", "MemoryAccounting": "yes", "MemoryCurrent": "2977792", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:35:08.801 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:32:16 UTC", "StateChangeTimestampMonotonic": "11858982", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:32:16 UTC", "WatchdogTimestampMonotonic": "11770098", "WatchdogUSec": "0"}} 2020-04-02T23:35:08.835 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.048) 0:02:09.469 ******** 2020-04-02T23:35:08.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-02T23:35:08.841 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:08.879 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.043) 0:02:09.513 ******** 2020-04-02T23:35:08.885 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:08.923 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.043) 0:02:09.557 ******** 2020-04-02T23:35:08.931 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-02T23:35:08.933 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:08.971 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:08 +0000 (0:00:00.047) 0:02:09.605 ******** 2020-04-02T23:35:08.977 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:09.015 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.044) 0:02:09.649 ******** 2020-04-02T23:35:09.020 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:35:09.022 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:09.060 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.044) 0:02:09.694 ******** 2020-04-02T23:35:09.066 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:09.105 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.044) 0:02:09.739 ******** 2020-04-02T23:35:09.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:35:09.257 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:35:09.294 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.189) 0:02:09.928 ******** 2020-04-02T23:35:09.311 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:35:09.349 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.054) 0:02:09.983 ******** 2020-04-02T23:35:09.796 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:35:09.798 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:35:09.833 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.483) 0:02:10.467 ******** 2020-04-02T23:35:09.840 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:35:09.883 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:09 +0000 (0:00:00.049) 0:02:10.517 ******** 2020-04-02T23:35:11.165 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:35:11.166 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:35:11.202 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:01.319) 0:02:11.837 ******** 2020-04-02T23:35:11.211 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:35:11.258 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.051) 0:02:11.889 ******** 2020-04-02T23:35:11.260 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:35:11.261 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.299 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.044) 0:02:11.934 ******** 2020-04-02T23:35:11.305 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.344 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.044) 0:02:11.978 ******** 2020-04-02T23:35:11.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:35:11.397 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.053) 0:02:12.031 ******** 2020-04-02T23:35:11.404 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:35:11.445 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.047) 0:02:12.079 ******** 2020-04-02T23:35:11.586 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:35:11.587 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:35:11.631 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.186) 0:02:12.265 ******** 2020-04-02T23:35:11.638 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:35:11.678 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.047) 0:02:12.312 ******** 2020-04-02T23:35:11.684 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:35:11.686 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.725 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.046) 0:02:12.359 ******** 2020-04-02T23:35:11.734 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.774 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.048) 0:02:12.408 ******** 2020-04-02T23:35:11.780 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-02T23:35:11.780 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:35:11.821 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.046) 0:02:12.455 ******** 2020-04-02T23:35:11.828 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:35:11.873 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.051) 0:02:12.507 ******** 2020-04-02T23:35:11.881 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-02T23:35:11.882 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.920 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.047) 0:02:12.554 ******** 2020-04-02T23:35:11.926 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:11.965 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:11 +0000 (0:00:00.045) 0:02:12.599 ******** 2020-04-02T23:35:12.114 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-02T23:35:12.115 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:35:12.155 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.189) 0:02:12.789 ******** 2020-04-02T23:35:12.170 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:35:12.208 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.053) 0:02:12.843 ******** 2020-04-02T23:35:12.349 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-02T23:35:12.349 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:35:12.388 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.179) 0:02:13.022 ******** 2020-04-02T23:35:12.404 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:35:12.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.053) 0:02:13.075 ******** 2020-04-02T23:35:12.446 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:35:12.448 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.484 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.043) 0:02:13.118 ******** 2020-04-02T23:35:12.492 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.532 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.047) 0:02:13.166 ******** 2020-04-02T23:35:12.533 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.539 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.541 INFO:teuthology.task.ansible.out:TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi190.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.542 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.544 INFO:teuthology.task.ansible.out: skipping: [smithi190.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.545 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.586 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.054) 0:02:13.220 ******** 2020-04-02T23:35:12.587 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.595 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.597 INFO:teuthology.task.ansible.out: skipping: [smithi078.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.598 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.599 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.643 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.057) 0:02:13.277 ******** 2020-04-02T23:35:12.645 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.650 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.651 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi190.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.652 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.654 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.655 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi190.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.702 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.058) 0:02:13.336 ******** 2020-04-02T23:35:12.704 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.707 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.709 INFO:teuthology.task.ansible.out: skipping: [smithi078.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.710 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.712 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.713 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.752 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.049) 0:02:13.386 ******** 2020-04-02T23:35:12.754 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.758 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.760 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.799 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.047) 0:02:13.433 ******** 2020-04-02T23:35:12.801 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.806 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.807 INFO:teuthology.task.ansible.out: 2020-04-02T23:35:12.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.049) 0:02:13.483 ******** 2020-04-02T23:35:12.854 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:35:12.856 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.044) 0:02:13.528 ******** 2020-04-02T23:35:12.899 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.043) 0:02:13.571 ******** 2020-04-02T23:35:12.943 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:35:12.944 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:12.989 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:12 +0000 (0:00:00.046) 0:02:13.618 ******** 2020-04-02T23:35:12.990 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.036 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.051) 0:02:13.670 ******** 2020-04-02T23:35:13.040 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:35:13.043 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.081 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.044) 0:02:13.715 ******** 2020-04-02T23:35:13.086 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.125 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.044) 0:02:13.759 ******** 2020-04-02T23:35:13.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:35:13.132 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.046) 0:02:13.806 ******** 2020-04-02T23:35:13.178 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.219 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.046) 0:02:13.853 ******** 2020-04-02T23:35:13.224 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:35:13.225 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.268 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.048) 0:02:13.902 ******** 2020-04-02T23:35:13.274 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.315 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.047) 0:02:13.949 ******** 2020-04-02T23:35:13.322 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:35:13.323 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.363 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.048) 0:02:13.998 ******** 2020-04-02T23:35:13.369 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.410 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.046) 0:02:14.044 ******** 2020-04-02T23:35:13.416 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:35:13.416 INFO:teuthology.task.ansible.out:skipping: [smithi190.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.045) 0:02:14.089 ******** 2020-04-02T23:35:13.463 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:35:13.501 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:13 +0000 (0:00:00.045) 0:02:14.135 ******** 2020-04-02T23:35:13.674 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:35:13.675 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004925", "end": "2020-04-02 23:35:13.641147", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:35:13.636222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:13.729 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004883", "end": "2020-04-02 23:35:13.688020", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:35:13.683137", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:13.854 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003000", "end": "2020-04-02 23:35:13.827003", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:35:13.824003", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:13.917 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002955", "end": "2020-04-02 23:35:13.883429", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:35:13.880474", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:14.062 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002817", "end": "2020-04-02 23:35:14.022336", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:35:14.019519", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:14.115 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002805", "end": "2020-04-02 23:35:14.078256", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:35:14.075451", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:14.265 INFO:teuthology.task.ansible.out:ok: [smithi190.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.013910", "end": "2020-04-02 23:35:14.230666", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:35:14.216756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:14.304 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:14 +0000 (0:00:00.803) 0:02:14.939 ******** 2020-04-02T23:35:14.320 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021993", "end": "2020-04-02 23:35:14.287566", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:35:14.265573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:35:14.359 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:14 +0000 (0:00:00.054) 0:02:14.993 ******** 2020-04-02T23:35:14.364 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:35:14.402 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:14 +0000 (0:00:00.042) 0:02:15.036 ******** 2020-04-02T23:35:14.444 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:35:14 +0000 (0:00:00.042) 0:02:15.078 ******** 2020-04-02T23:35:14.589 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:35:14.590 INFO:teuthology.task.ansible.out:changed: [smithi190.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:35:14.658 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:35:14.748 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-04-02T23:35:14.750 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-02T23:35:14.753 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-04-02T23:35:14.753 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi078.front.sepia.ceph.com : ok=111 changed=32 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi190.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Thursday 02 April 2020 23:35:14 +0000 (0:00:00.308) 0:02:15.387 ******** =============================================================================== 2020-04-02T23:35:14.755 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 14.95s common : nrpe - Load SELinux policy package ---------------------------- 14.74s testnode : Zap all non-root disks --------------------------------------- 7.63s testnode : Install packages --------------------------------------------- 6.82s testnode : Base group workaround for BZ1782899 -------------------------- 4.19s Gathering Facts --------------------------------------------------------- 3.51s testnode : Ensure ceph dependency packages are not present. ------------- 2.12s testnode : Create logical volume(s) ------------------------------------- 2.01s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.58s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.37s 2020-04-02T23:35:14.755 INFO:teuthology.task.ansible.out:testnode : Install packages via pip ------------------------------------- 1.32s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.25s testnode : Ensure ceph packages are not present. ------------------------ 1.23s common : Set the hardware clock ----------------------------------------- 1.12s common : Install Kerberos Packages (RedHat) ----------------------------- 1.09s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.98s common : nrpe - Ensure SELinux policy is up to date --------------------- 0.91s common : Configure local epel mirrorlists ------------------------------- 0.89s ansible-managed : Add authorized keys for the ansible user. ------------- 0.88s 2020-04-02T23:35:14.755 INFO:teuthology.task.ansible.out:ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.86s 2020-04-02T23:35:15.016 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi190.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2020-04-02T23:35:15.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:35:15.024 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi190.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:35:15.098 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:15.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:35:15.188 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi078.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:35:15.257 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:15.350 INFO:teuthology.run_tasks:Running task clock... 2020-04-02T23:35:15.363 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-02T23:35:15.363 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:15.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:35:15.377 INFO:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:35:15.451 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:35:15.469 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:35:15.534 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2020-04-02T23:35:15.536 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2020-04-02T23:35:15.538 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:35:15.556 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:35:15.653 INFO:teuthology.orchestra.run.smithi190.stdout:210 Number of sources = 4 2020-04-02T23:35:15.653 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:35:15.654 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2020-04-02T23:35:15.654 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.654 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.654 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.654 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.672 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2020-04-02T23:35:15.672 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:15.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:35:15.687 INFO:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:35:15.794 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:35:15.794 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:35:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2020-04-02T23:35:15.846 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2020-04-02T23:35:15.860 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:35:15.876 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:35:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2020-04-02T23:35:15.962 INFO:teuthology.orchestra.run.smithi078.stdout:210 Number of sources = 4 2020-04-02T23:35:15.962 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:35:15.962 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2020-04-02T23:35:15.962 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.963 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.963 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.963 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:35:15.963 INFO:teuthology.run_tasks:Running task install... 2020-04-02T23:35:15.974 DEBUG:teuthology.task.install:project ceph 2020-04-02T23:35:15.974 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'notcmalloc', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}} 2020-04-02T23:35:15.975 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'notcmalloc', 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:35:15.975 INFO:teuthology.task.install:Using flavor: notcmalloc 2020-04-02T23:35:15.981 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2020-04-02T23:35:15.982 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-04-02T23:35:15.982 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:15.996 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is 2020-04-02T23:35:16.074 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS 2020-04-02T23:35:16.075 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:35:16.075 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:16.076 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': True, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'notcmalloc', 'extras': None} 2020-04-02T23:35:16.076 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:16.089 INFO:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2020-04-02T23:35:16.127 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is 2020-04-02T23:35:16.164 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS 2020-04-02T23:35:16.166 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:35:16.166 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': True, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'notcmalloc', 'extras': None} 2020-04-02T23:35:16.166 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:16.202 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS 2020-04-02T23:35:16.203 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:35:16.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:35:16.220 INFO:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2020-04-02T23:35:16.315 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS 2020-04-02T23:35:16.316 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:35:16.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:35:16.483 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/ 2020-04-02T23:35:16.483 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:35:16.562 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/ 2020-04-02T23:35:16.563 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:35:16.669 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:35:16.669 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:16.683 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:35:16.747 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/notcmalloc/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:35:16.747 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:16.762 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:35:16.769 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:35:16.769 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:16.823 INFO:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:35:16.847 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:35:16.848 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:16.893 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:16.905 INFO:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:35:16.946 INFO:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:35:16.975 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:17.030 INFO:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:35:17.030 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:17.083 INFO:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:35:17.111 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:17.148 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2020-04-02T23:35:17.150 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:17.164 INFO:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:35:17.203 INFO:teuthology.orchestra.run.smithi190:> sudo yum clean all 2020-04-02T23:35:17.231 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2020-04-02T23:35:17.233 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:17.285 INFO:teuthology.orchestra.run.smithi078:> sudo yum clean all 2020-04-02T23:35:17.479 INFO:teuthology.orchestra.run.smithi190.stdout:50 files removed 2020-04-02T23:35:17.508 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:35:17.521 INFO:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:35:17.563 INFO:teuthology.orchestra.run.smithi078.stdout:50 files removed 2020-04-02T23:35:17.592 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:35:17.605 INFO:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:35:18.691 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 87 kB/s | 69 kB 00:00 2020-04-02T23:35:18.773 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 87 kB/s | 69 kB 00:00 2020-04-02T23:35:19.361 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 22 kB/s | 14 kB 00:00 2020-04-02T23:35:19.455 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 21 kB/s | 14 kB 00:00 2020-04-02T23:35:20.002 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 2.3 kB/s | 1.4 kB 00:00 2020-04-02T23:35:20.104 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 2.2 kB/s | 1.4 kB 00:00 2020-04-02T23:35:20.173 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - AppStream 47 MB/s | 6.6 MB 00:00 2020-04-02T23:35:20.263 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - AppStream 47 MB/s | 6.6 MB 00:00 2020-04-02T23:35:21.335 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - Base 41 MB/s | 5.0 MB 00:00 2020-04-02T23:35:21.414 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Base 40 MB/s | 5.0 MB 00:00 2020-04-02T23:35:22.100 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-8 - Extras 71 kB/s | 4.4 kB 00:00 2020-04-02T23:35:22.183 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-8 - Extras 68 kB/s | 4.4 kB 00:00 2020-04-02T23:35:22.243 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for ceph-el8 owned by ktdreyer 478 kB/s | 47 kB 00:00 2020-04-02T23:35:22.321 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for ceph-el8 owned by ktdreyer 505 kB/s | 47 kB 00:00 2020-04-02T23:35:22.587 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.2 MB 00:00 2020-04-02T23:35:22.748 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 16 MB/s | 6.2 MB 00:00 2020-04-02T23:35:23.891 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 5.5 MB/s | 30 kB 00:00 2020-04-02T23:35:23.989 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 6.4 MB/s | 30 kB 00:00 2020-04-02T23:35:24.776 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:35:24.777 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:35:24.785 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:35:24.786 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:35:24.787 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:35:24.787 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:35:24.867 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:35:24.867 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:35:24.876 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:35:24.877 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:35:24.878 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:35:24.878 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:35:24.911 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2020-04-02T23:35:24.925 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:35:24.925 INFO:teuthology.orchestra.run.smithi190.stdout: Package ArchVersion Repository Size 2020-04-02T23:35:24.925 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 108 M 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 608 M 2020-04-02T23:35:24.926 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 591 k 2020-04-02T23:35:24.927 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 12 M 2020-04-02T23:35:24.927 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 213 k 2020-04-02T23:35:24.927 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.4 M 2020-04-02T23:35:24.927 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 66 M 2020-04-02T23:35:24.927 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:35:24.928 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 36 M 2020-04-02T23:35:24.928 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 96 M 2020-04-02T23:35:24.928 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 329 M 2020-04-02T23:35:24.928 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.9 M 2020-04-02T23:35:24.929 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 329 M 2020-04-02T23:35:24.929 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 43 M 2020-04-02T23:35:24.930 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.0 G 2020-04-02T23:35:24.930 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:35:24.930 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:35:24.930 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 514 k 2020-04-02T23:35:24.930 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 10 M 2020-04-02T23:35:24.931 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:35:24.931 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 182 k 2020-04-02T23:35:24.931 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 73 M 2020-04-02T23:35:24.931 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 63 M 2020-04-02T23:35:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:35:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 431 k 2020-04-02T23:35:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:35:24.932 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.1 M 2020-04-02T23:35:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:35:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.1 M 2020-04-02T23:35:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:35:24.933 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 335 k 2020-04-02T23:35:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 81 k 2020-04-02T23:35:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.3 M 2020-04-02T23:35:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.8 M 2020-04-02T23:35:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 84 M 2020-04-02T23:35:24.934 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 151 k 2020-04-02T23:35:24.937 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.2 M 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:35:24.938 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2020-04-02T23:35:24.939 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.1 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:35:24.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 390 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:35:24.941 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:35:24.943 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:35:24.944 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:35:24.945 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:35:24.946 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:35:24.946 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:35:24.946 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:35:24.946 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:35:24.946 INFO:teuthology.orchestra.run.smithi190.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:35:24.947 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:35:24.947 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:35:24.947 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:35:24.947 INFO:teuthology.orchestra.run.smithi190.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:35:24.947 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:35:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:35:24.949 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:35:24.950 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:35:24.951 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:35:24.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:35:24.953 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:35:24.954 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2020-04-02T23:35:24.954 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2020-04-02T23:35:24.954 INFO:teuthology.orchestra.run.smithi190.stdout:Install 144 Packages 2020-04-02T23:35:24.954 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 2 Packages 2020-04-02T23:35:24.954 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:35:24.955 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 3.0 G 2020-04-02T23:35:24.955 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2020-04-02T23:35:25.007 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2020-04-02T23:35:25.021 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:35:25.021 INFO:teuthology.orchestra.run.smithi078.stdout: Package ArchVersion Repository Size 2020-04-02T23:35:25.022 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:35:25.022 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2020-04-02T23:35:25.023 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:35:25.023 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:35:25.023 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 108 M 2020-04-02T23:35:25.023 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 608 M 2020-04-02T23:35:25.023 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 591 k 2020-04-02T23:35:25.024 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 12 M 2020-04-02T23:35:25.024 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 213 k 2020-04-02T23:35:25.024 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.4 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 66 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 36 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 96 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 329 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.9 M 2020-04-02T23:35:25.025 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 329 M 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 43 M 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.0 G 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 514 k 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 10 M 2020-04-02T23:35:25.026 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 182 k 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 73 M 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 63 M 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 431 k 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:35:25.027 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.1 M 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.1 M 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 335 k 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 81 k 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.3 M 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.8 M 2020-04-02T23:35:25.028 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 84 M 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 151 k 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-debuginfo x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.2 M 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:35:25.029 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:35:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:35:25.031 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.1 M 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:35:25.033 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 390 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:35:25.034 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:35:25.035 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:35:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:35:25.037 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:35:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:35:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:35:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:35:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:35:25.043 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:35:25.043 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:35:25.043 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:35:25.043 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:35:25.044 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:35:25.044 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:35:25.044 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:35:25.044 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:35:25.045 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:35:25.046 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout:Install 144 Packages 2020-04-02T23:35:25.047 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 2 Packages 2020-04-02T23:35:25.048 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:35:25.048 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 3.0 G 2020-04-02T23:35:25.048 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2020-04-02T23:35:25.258 INFO:teuthology.orchestra.run.smithi190.stdout:(1/146): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 20 kB/s | 6.4 kB 00:00 2020-04-02T23:35:25.341 INFO:teuthology.orchestra.run.smithi078.stdout:(1/146): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 21 kB/s | 6.4 kB 00:00 2020-04-02T23:35:27.855 INFO:teuthology.orchestra.run.smithi078.stdout:(2/146): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 2.0 MB/s | 5.6 MB 00:02 2020-04-02T23:35:29.267 INFO:teuthology.orchestra.run.smithi190.stdout:(2/146): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 1.3 MB/s | 5.6 MB 00:04 2020-04-02T23:35:35.209 INFO:teuthology.orchestra.run.smithi190.stdout:(3/146): ceph-common-16.0.0-316.gcbb84f7.el8.x8 2.1 MB/s | 21 MB 00:09 2020-04-02T23:35:35.541 INFO:teuthology.orchestra.run.smithi190.stdout:(4/146): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.7 MB/s | 591 kB 00:00 2020-04-02T23:35:38.923 INFO:teuthology.orchestra.run.smithi078.stdout:(3/146): ceph-common-16.0.0-316.gcbb84f7.el8.x8 1.5 MB/s | 21 MB 00:13 2020-04-02T23:35:38.961 INFO:teuthology.orchestra.run.smithi190.stdout:(5/146): ceph-base-debuginfo-16.0.0-316.gcbb84f 7.7 MB/s | 108 MB 00:14 2020-04-02T23:35:39.047 INFO:teuthology.orchestra.run.smithi190.stdout:(6/146): ceph-immutable-object-cache-16.0.0-316 2.4 MB/s | 213 kB 00:00 2020-04-02T23:35:39.128 INFO:teuthology.orchestra.run.smithi078.stdout:(4/146): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.8 MB/s | 591 kB 00:00 2020-04-02T23:35:39.347 INFO:teuthology.orchestra.run.smithi190.stdout:(7/146): ceph-immutable-object-cache-debuginfo- 11 MB/s | 3.4 MB 00:00 2020-04-02T23:35:39.500 INFO:teuthology.orchestra.run.smithi190.stdout:(8/146): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 13 MB/s | 2.1 MB 00:00 2020-04-02T23:35:40.898 INFO:teuthology.orchestra.run.smithi190.stdout:(9/146): ceph-fuse-debuginfo-16.0.0-316.gcbb84f 2.2 MB/s | 12 MB 00:05 2020-04-02T23:35:41.564 INFO:teuthology.orchestra.run.smithi190.stdout:(10/146): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_ 2.2 MB/s | 1.4 MB 00:00 2020-04-02T23:35:44.604 INFO:teuthology.orchestra.run.smithi078.stdout:(5/146): ceph-fuse-debuginfo-16.0.0-316.gcbb84f 2.2 MB/s | 12 MB 00:05 2020-04-02T23:35:44.695 INFO:teuthology.orchestra.run.smithi078.stdout:(6/146): ceph-immutable-object-cache-16.0.0-316 2.3 MB/s | 213 kB 00:00 2020-04-02T23:35:45.588 INFO:teuthology.orchestra.run.smithi190.stdout:(11/146): ceph-mds-debuginfo-16.0.0-316.gcbb84f 11 MB/s | 66 MB 00:06 2020-04-02T23:35:45.875 INFO:teuthology.orchestra.run.smithi078.stdout:(7/146): ceph-immutable-object-cache-debuginfo- 2.9 MB/s | 3.4 MB 00:01 2020-04-02T23:35:46.222 INFO:teuthology.orchestra.run.smithi190.stdout:(12/146): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_ 6.9 MB/s | 4.4 MB 00:00 2020-04-02T23:35:46.801 INFO:teuthology.orchestra.run.smithi078.stdout:(8/146): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 2.2 MB/s | 2.1 MB 00:00 2020-04-02T23:35:57.750 INFO:teuthology.orchestra.run.smithi190.stdout:(13/146): ceph-mgr-debuginfo-16.0.0-316.gcbb84f 2.2 MB/s | 36 MB 00:16 2020-04-02T23:36:08.697 INFO:teuthology.orchestra.run.smithi190.stdout:(14/146): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_ 1.5 MB/s | 17 MB 00:10 2020-04-02T23:36:23.958 INFO:teuthology.orchestra.run.smithi078.stdout:(9/146): ceph-base-debuginfo-16.0.0-316.gcbb84f 1.8 MB/s | 108 MB 00:58 2020-04-02T23:36:25.244 INFO:teuthology.orchestra.run.smithi078.stdout:(10/146): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_ 1.1 MB/s | 1.4 MB 00:01 2020-04-02T23:36:27.863 INFO:teuthology.orchestra.run.smithi190.stdout:(15/146): ceph-mon-debuginfo-16.0.0-316.gcbb84f 2.3 MB/s | 96 MB 00:41 2020-04-02T23:36:29.118 INFO:teuthology.orchestra.run.smithi078.stdout:(11/146): ceph-mds-debuginfo-16.0.0-316.gcbb84f 1.6 MB/s | 66 MB 00:42 2020-04-02T23:36:30.934 INFO:teuthology.orchestra.run.smithi078.stdout:(12/146): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_ 2.4 MB/s | 4.4 MB 00:01 2020-04-02T23:36:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:(16/146): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 2.3 MB/s | 9.9 MB 00:04 2020-04-02T23:36:45.551 INFO:teuthology.orchestra.run.smithi078.stdout:(13/146): ceph-mgr-debuginfo-16.0.0-316.gcbb84f 1.8 MB/s | 36 MB 00:20 2020-04-02T23:36:51.829 INFO:teuthology.orchestra.run.smithi078.stdout:(14/146): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_ 2.7 MB/s | 17 MB 00:06 2020-04-02T23:37:14.146 INFO:teuthology.orchestra.run.smithi078.stdout:(15/146): ceph-mon-debuginfo-16.0.0-316.gcbb84f 2.2 MB/s | 96 MB 00:43 2020-04-02T23:37:15.935 INFO:teuthology.orchestra.run.smithi078.stdout:(16/146): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 5.5 MB/s | 9.9 MB 00:01 2020-04-02T23:37:23.719 INFO:teuthology.orchestra.run.smithi078.stdout:(17/146): ceph-common-debuginfo-16.0.0-316.gcbb 5.2 MB/s | 608 MB 01:55 2020-04-02T23:37:23.852 INFO:teuthology.orchestra.run.smithi078.stdout:(18/146): ceph-selinux-16.0.0-316.gcbb84f7.el8. 186 kB/s | 25 kB 00:00 2020-04-02T23:37:31.823 INFO:teuthology.orchestra.run.smithi190.stdout:(17/146): ceph-common-debuginfo-16.0.0-316.gcbb 5.0 MB/s | 608 MB 02:02 2020-04-02T23:37:31.898 INFO:teuthology.orchestra.run.smithi190.stdout:(18/146): ceph-selinux-16.0.0-316.gcbb84f7.el8. 334 kB/s | 25 kB 00:00 2020-04-02T23:37:35.852 INFO:teuthology.orchestra.run.smithi190.stdout:(19/146): ceph-test-16.0.0-316.gcbb84f7.el8.x86 11 MB/s | 43 MB 00:03 2020-04-02T23:37:37.762 INFO:teuthology.orchestra.run.smithi078.stdout:(19/146): ceph-test-16.0.0-316.gcbb84f7.el8.x86 3.1 MB/s | 43 MB 00:13 2020-04-02T23:38:22.154 INFO:teuthology.orchestra.run.smithi190.stdout:(20/146): ceph-radosgw-debuginfo-16.0.0-316.gcb 3.0 MB/s | 329 MB 01:50 2020-04-02T23:38:22.337 INFO:teuthology.orchestra.run.smithi190.stdout:(21/146): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 220 kB/s | 39 kB 00:00 2020-04-02T23:38:22.424 INFO:teuthology.orchestra.run.smithi190.stdout:(22/146): libcephfs-devel-16.0.0-316.gcbb84f7.e 236 kB/s | 21 kB 00:00 2020-04-02T23:38:22.872 INFO:teuthology.orchestra.run.smithi190.stdout:(23/146): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 1.1 MB/s | 514 kB 00:00 2020-04-02T23:38:27.110 INFO:teuthology.orchestra.run.smithi190.stdout:(24/146): libcephfs2-debuginfo-16.0.0-316.gcbb8 2.5 MB/s | 10 MB 00:04 2020-04-02T23:38:27.195 INFO:teuthology.orchestra.run.smithi190.stdout:(25/146): librados-devel-16.0.0-316.gcbb84f7.el 1.6 MB/s | 141 kB 00:00 2020-04-02T23:38:27.278 INFO:teuthology.orchestra.run.smithi190.stdout:(26/146): librados-devel-debuginfo-16.0.0-316.g 2.2 MB/s | 182 kB 00:00 2020-04-02T23:38:29.431 INFO:teuthology.orchestra.run.smithi190.stdout:(27/146): ceph-osd-debuginfo-16.0.0-316.gcbb84f 2.3 MB/s | 329 MB 02:20 2020-04-02T23:38:29.856 INFO:teuthology.orchestra.run.smithi190.stdout:(28/146): libradosstriper1-16.0.0-316.gcbb84f7. 919 kB/s | 390 kB 00:00 2020-04-02T23:38:39.615 INFO:teuthology.orchestra.run.smithi078.stdout:(20/146): ceph-osd-debuginfo-16.0.0-316.gcbb84f 3.0 MB/s | 329 MB 01:47 2020-04-02T23:38:39.653 INFO:teuthology.orchestra.run.smithi078.stdout:(21/146): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 1.0 MB/s | 39 kB 00:00 2020-04-02T23:38:39.697 INFO:teuthology.orchestra.run.smithi078.stdout:(22/146): libcephfs-devel-16.0.0-316.gcbb84f7.e 474 kB/s | 21 kB 00:00 2020-04-02T23:38:39.933 INFO:teuthology.orchestra.run.smithi078.stdout:(23/146): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 2.1 MB/s | 514 kB 00:00 2020-04-02T23:38:42.515 INFO:teuthology.orchestra.run.smithi078.stdout:(24/146): libcephfs2-debuginfo-16.0.0-316.gcbb8 4.0 MB/s | 10 MB 00:02 2020-04-02T23:38:42.604 INFO:teuthology.orchestra.run.smithi078.stdout:(25/146): librados-devel-16.0.0-316.gcbb84f7.el 1.6 MB/s | 141 kB 00:00 2020-04-02T23:38:42.692 INFO:teuthology.orchestra.run.smithi078.stdout:(26/146): librados-devel-debuginfo-16.0.0-316.g 2.0 MB/s | 182 kB 00:00 2020-04-02T23:38:43.452 INFO:teuthology.orchestra.run.smithi190.stdout:(29/146): librbd1-debuginfo-16.0.0-316.gcbb84f7 4.6 MB/s | 63 MB 00:13 2020-04-02T23:38:44.287 INFO:teuthology.orchestra.run.smithi190.stdout:(30/146): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 3.8 MB/s | 3.2 MB 00:00 2020-04-02T23:38:44.374 INFO:teuthology.orchestra.run.smithi190.stdout:(31/146): python3-ceph-argparse-16.0.0-316.gcbb 457 kB/s | 40 kB 00:00 2020-04-02T23:38:44.459 INFO:teuthology.orchestra.run.smithi190.stdout:(32/146): python3-ceph-common-16.0.0-316.gcbb84 729 kB/s | 62 kB 00:00 2020-04-02T23:38:44.548 INFO:teuthology.orchestra.run.smithi190.stdout:(33/146): python3-cephfs-16.0.0-316.gcbb84f7.el 1.8 MB/s | 162 kB 00:00 2020-04-02T23:38:44.934 INFO:teuthology.orchestra.run.smithi190.stdout:(34/146): python3-cephfs-debuginfo-16.0.0-316.g 1.1 MB/s | 431 kB 00:00 2020-04-02T23:38:45.041 INFO:teuthology.orchestra.run.smithi190.stdout:(35/146): python3-rados-16.0.0-316.gcbb84f7.el8 3.2 MB/s | 352 kB 00:00 2020-04-02T23:38:45.276 INFO:teuthology.orchestra.run.smithi190.stdout:(36/146): python3-rados-debuginfo-16.0.0-316.gc 4.6 MB/s | 1.1 MB 00:00 2020-04-02T23:38:45.355 INFO:teuthology.orchestra.run.smithi190.stdout:(37/146): python3-rbd-16.0.0-316.gcbb84f7.el8.x 4.1 MB/s | 331 kB 00:00 2020-04-02T23:38:45.529 INFO:teuthology.orchestra.run.smithi190.stdout:(38/146): python3-rbd-debuginfo-16.0.0-316.gcbb 6.1 MB/s | 1.1 MB 00:00 2020-04-02T23:38:45.567 INFO:teuthology.orchestra.run.smithi190.stdout:(39/146): python3-rgw-16.0.0-316.gcbb84f7.el8.x 2.9 MB/s | 113 kB 00:00 2020-04-02T23:38:45.644 INFO:teuthology.orchestra.run.smithi190.stdout:(40/146): python3-rgw-debuginfo-16.0.0-316.gcbb 4.2 MB/s | 335 kB 00:00 2020-04-02T23:38:45.685 INFO:teuthology.orchestra.run.smithi190.stdout:(41/146): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.9 MB/s | 81 kB 00:00 2020-04-02T23:38:45.898 INFO:teuthology.orchestra.run.smithi190.stdout:(42/146): rbd-fuse-debuginfo-16.0.0-316.gcbb84f 6.3 MB/s | 1.3 MB 00:00 2020-04-02T23:38:46.260 INFO:teuthology.orchestra.run.smithi190.stdout:(43/146): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 7.7 MB/s | 2.8 MB 00:00 2020-04-02T23:38:46.437 INFO:teuthology.orchestra.run.smithi078.stdout:(27/146): ceph-radosgw-debuginfo-16.0.0-316.gcb 3.6 MB/s | 329 MB 01:30 2020-04-02T23:38:46.853 INFO:teuthology.orchestra.run.smithi078.stdout:(28/146): libradosstriper1-16.0.0-316.gcbb84f7. 939 kB/s | 390 kB 00:00 2020-04-02T23:38:56.471 INFO:teuthology.orchestra.run.smithi190.stdout:(44/146): librados2-debuginfo-16.0.0-316.gcbb84 2.5 MB/s | 73 MB 00:29 2020-04-02T23:38:56.642 INFO:teuthology.orchestra.run.smithi190.stdout:(45/146): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 883 kB/s | 151 kB 00:00 2020-04-02T23:38:57.395 INFO:teuthology.orchestra.run.smithi190.stdout:(46/146): rbd-nbd-debuginfo-16.0.0-316.gcbb84f7 2.9 MB/s | 2.2 MB 00:00 2020-04-02T23:38:57.483 INFO:teuthology.orchestra.run.smithi190.stdout:(47/146): ceph-grafana-dashboards-16.0.0-316.gc 257 kB/s | 22 kB 00:00 2020-04-02T23:38:57.570 INFO:teuthology.orchestra.run.smithi190.stdout:(48/146): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 456 kB/s | 40 kB 00:00 2020-04-02T23:38:58.709 INFO:teuthology.orchestra.run.smithi190.stdout:(49/146): ceph-mgr-dashboard-16.0.0-316.gcbb84f 2.9 MB/s | 3.3 MB 00:01 2020-04-02T23:39:01.470 INFO:teuthology.orchestra.run.smithi190.stdout:(50/146): ceph-mgr-diskprediction-local-16.0.0- 3.1 MB/s | 8.6 MB 00:02 2020-04-02T23:39:01.559 INFO:teuthology.orchestra.run.smithi190.stdout:(51/146): ceph-mgr-modules-core-16.0.0-316.gcbb 1.8 MB/s | 161 kB 00:00 2020-04-02T23:39:01.640 INFO:teuthology.orchestra.run.smithi190.stdout:(52/146): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 335 kB/s | 27 kB 00:00 2020-04-02T23:39:01.722 INFO:teuthology.orchestra.run.smithi190.stdout:(53/146): ceph-prometheus-alerts-16.0.0-316.gcb 107 kB/s | 8.7 kB 00:00 2020-04-02T23:39:01.762 INFO:teuthology.orchestra.run.smithi190.stdout:(54/146): automake-1.16.1-6.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2020-04-02T23:39:01.771 INFO:teuthology.orchestra.run.smithi190.stdout:(55/146): bison-3.0.4-10.el8.x86_64.rpm 75 MB/s | 688 kB 00:00 2020-04-02T23:39:01.775 INFO:teuthology.orchestra.run.smithi190.stdout:(56/146): flex-2.6.1-9.el8.x86_64.rpm 72 MB/s | 320 kB 00:00 2020-04-02T23:39:01.778 INFO:teuthology.orchestra.run.smithi190.stdout:(57/146): jq-1.5-12.el8.x86_64.rpm 57 MB/s | 161 kB 00:00 2020-04-02T23:39:01.783 INFO:teuthology.orchestra.run.smithi190.stdout:(58/146): librdkafka-0.11.4-1.el8.x86_64.rpm 71 MB/s | 353 kB 00:00 2020-04-02T23:39:01.792 INFO:teuthology.orchestra.run.smithi190.stdout:(59/146): libtool-2.4.6-25.el8.x86_64.rpm 78 MB/s | 709 kB 00:00 2020-04-02T23:39:01.808 INFO:teuthology.orchestra.run.smithi190.stdout:(60/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2020-04-02T23:39:01.811 INFO:teuthology.orchestra.run.smithi190.stdout:(61/146): oniguruma-6.8.2-1.el8.x86_64.rpm 59 MB/s | 188 kB 00:00 2020-04-02T23:39:01.862 INFO:teuthology.orchestra.run.smithi190.stdout:(62/146): openblas-0.3.3-2.el8.x86_64.rpm 86 MB/s | 4.3 MB 00:00 2020-04-02T23:39:01.913 INFO:teuthology.orchestra.run.smithi190.stdout:(63/146): openblas-threads-0.3.3-2.el8.x86_64.r 86 MB/s | 4.4 MB 00:00 2020-04-02T23:39:01.916 INFO:teuthology.orchestra.run.smithi190.stdout:(64/146): python3-html5lib-0.999999999-6.el8.no 63 MB/s | 214 kB 00:00 2020-04-02T23:39:01.918 INFO:teuthology.orchestra.run.smithi190.stdout:(65/146): python3-jsonpatch-1.21-2.el8.noarch.r 24 MB/s | 27 kB 00:00 2020-04-02T23:39:01.919 INFO:teuthology.orchestra.run.smithi190.stdout:(66/146): python3-jsonpointer-1.10-11.el8.noarc 15 MB/s | 20 kB 00:00 2020-04-02T23:39:01.937 INFO:teuthology.orchestra.run.smithi190.stdout:(67/146): python3-lxml-4.2.3-1.el8.x86_64.rpm 83 MB/s | 1.5 MB 00:00 2020-04-02T23:39:01.940 INFO:teuthology.orchestra.run.smithi190.stdout:(68/146): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2020-04-02T23:39:01.941 INFO:teuthology.orchestra.run.smithi190.stdout:(69/146): python3-markupsafe-0.23-19.el8.x86_64 32 MB/s | 39 kB 00:00 2020-04-02T23:39:01.985 INFO:teuthology.orchestra.run.smithi190.stdout:(70/146): python3-numpy-1.14.3-9.el8.x86_64.rpm 86 MB/s | 3.7 MB 00:00 2020-04-02T23:39:01.989 INFO:teuthology.orchestra.run.smithi190.stdout:(71/146): python3-numpy-f2py-1.14.3-9.el8.x86_6 62 MB/s | 225 kB 00:00 2020-04-02T23:39:01.991 INFO:teuthology.orchestra.run.smithi190.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 30 MB/s | 44 kB 00:00 2020-04-02T23:39:01.993 INFO:teuthology.orchestra.run.smithi190.stdout:(73/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 55 MB/s | 126 kB 00:00 2020-04-02T23:39:01.995 INFO:teuthology.orchestra.run.smithi190.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 52 MB/s | 110 kB 00:00 2020-04-02T23:39:01.997 INFO:teuthology.orchestra.run.smithi190.stdout:(75/146): python3-pytz-2017.2-9.el8.noarch.rpm 36 MB/s | 54 kB 00:00 2020-04-02T23:39:02.199 INFO:teuthology.orchestra.run.smithi190.stdout:(76/146): python3-scipy-1.0.0-20.module_el8.1.0 72 MB/s | 15 MB 00:00 2020-04-02T23:39:02.201 INFO:teuthology.orchestra.run.smithi190.stdout:(77/146): python3-webencodings-0.5.1-6.el8.noar 19 MB/s | 27 kB 00:00 2020-04-02T23:39:02.207 INFO:teuthology.orchestra.run.smithi190.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 74 MB/s | 457 kB 00:00 2020-04-02T23:39:02.211 INFO:teuthology.orchestra.run.smithi190.stdout:(79/146): socat-1.7.3.2-6.el8.x86_64.rpm 72 MB/s | 298 kB 00:00 2020-04-02T23:39:02.213 INFO:teuthology.orchestra.run.smithi190.stdout:(80/146): elfutils-libelf-devel-0.176-5.el8.x86 36 MB/s | 54 kB 00:00 2020-04-02T23:39:02.215 INFO:teuthology.orchestra.run.smithi190.stdout:(81/146): fuse-2.9.7-12.el8.x86_64.rpm 45 MB/s | 82 kB 00:00 2020-04-02T23:39:02.216 INFO:teuthology.orchestra.run.smithi190.stdout:(82/146): fuse-common-3.2.1-12.el8.x86_64.rpm 19 MB/s | 21 kB 00:00 2020-04-02T23:39:02.217 INFO:teuthology.orchestra.run.smithi190.stdout:(83/146): keyutils-libs-devel-1.5.10-6.el8.x86_ 32 MB/s | 48 kB 00:00 2020-04-02T23:39:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:(84/146): krb5-devel-1.17-9.el8.x86_64.rpm 76 MB/s | 548 kB 00:00 2020-04-02T23:39:02.226 INFO:teuthology.orchestra.run.smithi190.stdout:(85/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 16 MB/s | 19 kB 00:00 2020-04-02T23:39:02.240 INFO:teuthology.orchestra.run.smithi190.stdout:(86/146): libcom_err-devel-1.44.6-3.el8.x86_64. 2.6 MB/s | 38 kB 00:00 2020-04-02T23:39:02.248 INFO:teuthology.orchestra.run.smithi190.stdout:(87/146): libgfortran-8.3.1-4.5.el8.x86_64.rpm 78 MB/s | 638 kB 00:00 2020-04-02T23:39:02.251 INFO:teuthology.orchestra.run.smithi190.stdout:(88/146): libquadmath-8.3.1-4.5.el8.x86_64.rpm 60 MB/s | 169 kB 00:00 2020-04-02T23:39:02.253 INFO:teuthology.orchestra.run.smithi190.stdout:(89/146): librabbitmq-0.9.0-1.el8.x86_64.rpm 33 MB/s | 47 kB 00:00 2020-04-02T23:39:02.256 INFO:teuthology.orchestra.run.smithi190.stdout:(90/146): libselinux-devel-2.9-2.1.el8.x86_64.r 64 MB/s | 199 kB 00:00 2020-04-02T23:39:02.258 INFO:teuthology.orchestra.run.smithi190.stdout:(91/146): libsepol-devel-2.9-1.el8.x86_64.rpm 46 MB/s | 86 kB 00:00 2020-04-02T23:39:02.260 INFO:teuthology.orchestra.run.smithi190.stdout:(92/146): libuuid-devel-2.32.1-17.el8.x86_64.rp 50 MB/s | 95 kB 00:00 2020-04-02T23:39:02.261 INFO:teuthology.orchestra.run.smithi190.stdout:(93/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-04-02T23:39:02.265 INFO:teuthology.orchestra.run.smithi190.stdout:(94/146): libxslt-1.1.32-3.el8.x86_64.rpm 69 MB/s | 249 kB 00:00 2020-04-02T23:39:02.291 INFO:teuthology.orchestra.run.smithi078.stdout:(29/146): librbd1-debuginfo-16.0.0-316.gcbb84f7 4.1 MB/s | 63 MB 00:15 2020-04-02T23:39:02.292 INFO:teuthology.orchestra.run.smithi190.stdout:(95/146): openssl-devel-1.1.1c-2.el8.x86_64.rpm 84 MB/s | 2.3 MB 00:00 2020-04-02T23:39:02.300 INFO:teuthology.orchestra.run.smithi190.stdout:(96/146): pcre2-devel-10.32-1.el8.x86_64.rpm 77 MB/s | 605 kB 00:00 2020-04-02T23:39:02.304 INFO:teuthology.orchestra.run.smithi190.stdout:(97/146): pcre2-utf16-10.32-1.el8.x86_64.rpm 67 MB/s | 228 kB 00:00 2020-04-02T23:39:02.307 INFO:teuthology.orchestra.run.smithi190.stdout:(98/146): pcre2-utf32-10.32-1.el8.x86_64.rpm 66 MB/s | 220 kB 00:00 2020-04-02T23:39:02.310 INFO:teuthology.orchestra.run.smithi190.stdout:(99/146): python3-chardet-3.0.4-7.el8.noarch.rp 62 MB/s | 195 kB 00:00 2020-04-02T23:39:02.312 INFO:teuthology.orchestra.run.smithi190.stdout:(100/146): python3-jwt-1.6.1-2.el8.noarch.rpm 29 MB/s | 43 kB 00:00 2020-04-02T23:39:02.315 INFO:teuthology.orchestra.run.smithi190.stdout:(101/146): python3-oauthlib-2.1.0-1.el8.noarch. 60 MB/s | 155 kB 00:00 2020-04-02T23:39:02.316 INFO:teuthology.orchestra.run.smithi190.stdout:(102/146): python3-pysocks-1.6.8-3.el8.noarch.r 28 MB/s | 34 kB 00:00 2020-04-02T23:39:02.318 INFO:teuthology.orchestra.run.smithi190.stdout:(103/146): python3-requests-2.20.0-2.1.el8_1.no 54 MB/s | 123 kB 00:00 2020-04-02T23:39:02.320 INFO:teuthology.orchestra.run.smithi190.stdout:(104/146): python3-requests-oauthlib-1.0.0-1.el 32 MB/s | 43 kB 00:00 2020-04-02T23:39:02.323 INFO:teuthology.orchestra.run.smithi190.stdout:(105/146): python3-urllib3-1.24.2-2.el8.noarch. 63 MB/s | 176 kB 00:00 2020-04-02T23:39:02.325 INFO:teuthology.orchestra.run.smithi190.stdout:(106/146): xfsprogs-devel-5.0.0-1.el8.x86_64.rp 37 MB/s | 69 kB 00:00 2020-04-02T23:39:02.326 INFO:teuthology.orchestra.run.smithi190.stdout:(107/146): zlib-devel-1.2.11-10.el8.x86_64.rpm 37 MB/s | 56 kB 00:00 2020-04-02T23:39:02.388 INFO:teuthology.orchestra.run.smithi190.stdout:(108/146): python3-cheroot-8.2.1-1.el8.noarch.r 2.3 MB/s | 145 kB 00:00 2020-04-02T23:39:02.410 INFO:teuthology.orchestra.run.smithi190.stdout:(109/146): python3-cherrypy-18.4.0-1.el8.noarch 18 MB/s | 385 kB 00:00 2020-04-02T23:39:02.423 INFO:teuthology.orchestra.run.smithi190.stdout:(110/146): python3-execnet-1.7.1-1.el8.2.noarch 27 MB/s | 356 kB 00:00 2020-04-02T23:39:02.431 INFO:teuthology.orchestra.run.smithi190.stdout:(111/146): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-04-02T23:39:02.440 INFO:teuthology.orchestra.run.smithi190.stdout:(112/146): python3-jaraco-functools-2.0-4.el8.n 2.1 MB/s | 18 kB 00:00 2020-04-02T23:39:02.448 INFO:teuthology.orchestra.run.smithi190.stdout:(113/146): python3-logutils-0.3.5-11.el8.noarch 5.6 MB/s | 49 kB 00:00 2020-04-02T23:39:02.457 INFO:teuthology.orchestra.run.smithi190.stdout:(114/146): python3-more-itertools-7.2.0-4.el8.n 6.7 MB/s | 59 kB 00:00 2020-04-02T23:39:02.469 INFO:teuthology.orchestra.run.smithi190.stdout:(115/146): python3-pecan-1.3.2-9.el8.noarch.rpm 24 MB/s | 283 kB 00:00 2020-04-02T23:39:02.478 INFO:teuthology.orchestra.run.smithi190.stdout:(116/146): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-02T23:39:02.487 INFO:teuthology.orchestra.run.smithi190.stdout:(117/146): python3-remoto-1.1.4-4.el8.noarch.rp 5.2 MB/s | 48 kB 00:00 2020-04-02T23:39:02.495 INFO:teuthology.orchestra.run.smithi190.stdout:(118/146): python3-repoze-lru-0.7-6.el8.noarch. 3.9 MB/s | 34 kB 00:00 2020-04-02T23:39:02.509 INFO:teuthology.orchestra.run.smithi190.stdout:(119/146): python3-routes-2.4.1-12.el8.noarch.r 14 MB/s | 197 kB 00:00 2020-04-02T23:39:02.517 INFO:teuthology.orchestra.run.smithi190.stdout:(120/146): python3-simplegeneric-0.8.1-17.el8.n 2.3 MB/s | 19 kB 00:00 2020-04-02T23:39:02.525 INFO:teuthology.orchestra.run.smithi190.stdout:(121/146): python3-singledispatch-3.4.0.3-18.el 3.0 MB/s | 24 kB 00:00 2020-04-02T23:39:02.534 INFO:teuthology.orchestra.run.smithi190.stdout:(122/146): python3-tempora-1.14.1-5.el8.noarch. 3.4 MB/s | 30 kB 00:00 2020-04-02T23:39:02.543 INFO:teuthology.orchestra.run.smithi190.stdout:(123/146): python3-trustme-0.5.2-4.el8.noarch.r 3.0 MB/s | 27 kB 00:00 2020-04-02T23:39:02.551 INFO:teuthology.orchestra.run.smithi190.stdout:(124/146): python3-zc-lockfile-2.0-2.el8.noarch 2.7 MB/s | 23 kB 00:00 2020-04-02T23:39:02.700 INFO:teuthology.orchestra.run.smithi190.stdout:(125/146): gperftools-libs-2.7-6.el8.x86_64.rpm 2.1 MB/s | 315 kB 00:00 2020-04-02T23:39:02.720 INFO:teuthology.orchestra.run.smithi190.stdout:(126/146): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-02T23:39:02.739 INFO:teuthology.orchestra.run.smithi190.stdout:(127/146): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-02T23:39:02.758 INFO:teuthology.orchestra.run.smithi190.stdout:(128/146): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-04-02T23:39:02.778 INFO:teuthology.orchestra.run.smithi190.stdout:(129/146): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-04-02T23:39:02.799 INFO:teuthology.orchestra.run.smithi190.stdout:(130/146): python3-beautifulsoup4-4.6.3-2.el8.1 8.6 MB/s | 185 kB 00:00 2020-04-02T23:39:02.818 INFO:teuthology.orchestra.run.smithi190.stdout:(131/146): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-04-02T23:39:02.837 INFO:teuthology.orchestra.run.smithi190.stdout:(132/146): python3-certifi-2018.10.15-7.el8.noa 853 kB/s | 16 kB 00:00 2020-04-02T23:39:02.858 INFO:teuthology.orchestra.run.smithi190.stdout:(133/146): python3-cssselect-0.9.2-10.el8.noarc 1.9 MB/s | 40 kB 00:00 2020-04-02T23:39:02.877 INFO:teuthology.orchestra.run.smithi190.stdout:(134/146): python3-google-auth-1.1.1-10.el8.noa 4.1 MB/s | 81 kB 00:00 2020-04-02T23:39:02.955 INFO:teuthology.orchestra.run.smithi190.stdout:(135/146): python3-kubernetes-10.0.1-2.el8.noar 14 MB/s | 1.1 MB 00:00 2020-04-02T23:39:02.974 INFO:teuthology.orchestra.run.smithi190.stdout:(136/146): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-02T23:39:02.995 INFO:teuthology.orchestra.run.smithi190.stdout:(137/146): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-04-02T23:39:03.015 INFO:teuthology.orchestra.run.smithi190.stdout:(138/146): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-04-02T23:39:03.034 INFO:teuthology.orchestra.run.smithi190.stdout:(139/146): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-04-02T23:39:03.054 INFO:teuthology.orchestra.run.smithi190.stdout:(140/146): python3-webtest-2.0.33-1.el8.noarch. 4.3 MB/s | 85 kB 00:00 2020-04-02T23:39:03.073 INFO:teuthology.orchestra.run.smithi190.stdout:(141/146): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-02T23:39:03.078 INFO:teuthology.orchestra.run.smithi190.stdout:(142/146): leveldb-1.21-2.el8.x86_64.rpm 40 MB/s | 179 kB 00:00 2020-04-02T23:39:03.307 INFO:teuthology.orchestra.run.smithi078.stdout:(30/146): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 3.1 MB/s | 3.2 MB 00:01 2020-04-02T23:39:03.396 INFO:teuthology.orchestra.run.smithi078.stdout:(31/146): python3-ceph-argparse-16.0.0-316.gcbb 445 kB/s | 40 kB 00:00 2020-04-02T23:39:03.486 INFO:teuthology.orchestra.run.smithi078.stdout:(32/146): python3-ceph-common-16.0.0-316.gcbb84 686 kB/s | 62 kB 00:00 2020-04-02T23:39:04.191 INFO:teuthology.orchestra.run.smithi078.stdout:(33/146): python3-cephfs-16.0.0-316.gcbb84f7.el 229 kB/s | 162 kB 00:00 2020-04-02T23:39:04.561 INFO:teuthology.orchestra.run.smithi078.stdout:(34/146): python3-cephfs-debuginfo-16.0.0-316.g 1.1 MB/s | 431 kB 00:00 2020-04-02T23:39:04.718 INFO:teuthology.orchestra.run.smithi078.stdout:(35/146): python3-rados-16.0.0-316.gcbb84f7.el8 2.2 MB/s | 352 kB 00:00 2020-04-02T23:39:04.785 INFO:teuthology.orchestra.run.smithi190.stdout:(143/146): librados2-16.0.0-316.gcbb84f7.el8.x8 2.1 MB/s | 3.6 MB 00:01 2020-04-02T23:39:05.077 INFO:teuthology.orchestra.run.smithi078.stdout:(36/146): python3-rados-debuginfo-16.0.0-316.gc 3.0 MB/s | 1.1 MB 00:00 2020-04-02T23:39:05.203 INFO:teuthology.orchestra.run.smithi078.stdout:(37/146): python3-rbd-16.0.0-316.gcbb84f7.el8.x 2.6 MB/s | 331 kB 00:00 2020-04-02T23:39:05.453 INFO:teuthology.orchestra.run.smithi190.stdout:(144/146): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 2.9 MB/s | 2.0 MB 00:00 2020-04-02T23:39:05.461 INFO:teuthology.orchestra.run.smithi078.stdout:(38/146): python3-rbd-debuginfo-16.0.0-316.gcbb 4.1 MB/s | 1.1 MB 00:00 2020-04-02T23:39:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:(39/146): python3-rgw-16.0.0-316.gcbb84f7.el8.x 2.1 MB/s | 113 kB 00:00 2020-04-02T23:39:05.576 INFO:teuthology.orchestra.run.smithi078.stdout:(40/146): python3-rgw-debuginfo-16.0.0-316.gcbb 5.3 MB/s | 335 kB 00:00 2020-04-02T23:39:05.628 INFO:teuthology.orchestra.run.smithi078.stdout:(41/146): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.5 MB/s | 81 kB 00:00 2020-04-02T23:39:05.876 INFO:teuthology.orchestra.run.smithi078.stdout:(42/146): rbd-fuse-debuginfo-16.0.0-316.gcbb84f 5.4 MB/s | 1.3 MB 00:00 2020-04-02T23:39:06.431 INFO:teuthology.orchestra.run.smithi078.stdout:(43/146): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 5.0 MB/s | 2.8 MB 00:00 2020-04-02T23:39:10.566 INFO:teuthology.orchestra.run.smithi078.stdout:(44/146): librados2-debuginfo-16.0.0-316.gcbb84 2.6 MB/s | 73 MB 00:27 2020-04-02T23:39:10.699 INFO:teuthology.orchestra.run.smithi078.stdout:(45/146): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 1.1 MB/s | 151 kB 00:00 2020-04-02T23:39:11.228 INFO:teuthology.orchestra.run.smithi078.stdout:(46/146): rbd-nbd-debuginfo-16.0.0-316.gcbb84f7 4.1 MB/s | 2.2 MB 00:00 2020-04-02T23:39:11.307 INFO:teuthology.orchestra.run.smithi078.stdout:(47/146): ceph-grafana-dashboards-16.0.0-316.gc 285 kB/s | 22 kB 00:00 2020-04-02T23:39:11.387 INFO:teuthology.orchestra.run.smithi078.stdout:(48/146): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 498 kB/s | 40 kB 00:00 2020-04-02T23:39:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:(49/146): ceph-mgr-dashboard-16.0.0-316.gcbb84f 3.9 MB/s | 3.3 MB 00:00 2020-04-02T23:39:14.102 INFO:teuthology.orchestra.run.smithi078.stdout:(50/146): ceph-mgr-diskprediction-local-16.0.0- 4.6 MB/s | 8.6 MB 00:01 2020-04-02T23:39:14.107 INFO:teuthology.orchestra.run.smithi190.stdout:(145/146): rbd-mirror-debuginfo-16.0.0-316.gcbb 3.0 MB/s | 84 MB 00:27 2020-04-02T23:39:14.152 INFO:teuthology.orchestra.run.smithi078.stdout:(51/146): ceph-mgr-modules-core-16.0.0-316.gcbb 3.2 MB/s | 161 kB 00:00 2020-04-02T23:39:14.214 INFO:teuthology.orchestra.run.smithi078.stdout:(52/146): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 440 kB/s | 27 kB 00:00 2020-04-02T23:39:14.275 INFO:teuthology.orchestra.run.smithi078.stdout:(53/146): ceph-prometheus-alerts-16.0.0-316.gcb 144 kB/s | 8.7 kB 00:00 2020-04-02T23:39:14.315 INFO:teuthology.orchestra.run.smithi078.stdout:(54/146): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-04-02T23:39:14.324 INFO:teuthology.orchestra.run.smithi078.stdout:(55/146): bison-3.0.4-10.el8.x86_64.rpm 76 MB/s | 688 kB 00:00 2020-04-02T23:39:14.329 INFO:teuthology.orchestra.run.smithi078.stdout:(56/146): flex-2.6.1-9.el8.x86_64.rpm 70 MB/s | 320 kB 00:00 2020-04-02T23:39:14.331 INFO:teuthology.orchestra.run.smithi078.stdout:(57/146): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-04-02T23:39:14.336 INFO:teuthology.orchestra.run.smithi078.stdout:(58/146): librdkafka-0.11.4-1.el8.x86_64.rpm 71 MB/s | 353 kB 00:00 2020-04-02T23:39:14.345 INFO:teuthology.orchestra.run.smithi078.stdout:(59/146): libtool-2.4.6-25.el8.x86_64.rpm 78 MB/s | 709 kB 00:00 2020-04-02T23:39:14.349 INFO:teuthology.orchestra.run.smithi078.stdout:(60/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-02T23:39:14.352 INFO:teuthology.orchestra.run.smithi078.stdout:(61/146): oniguruma-6.8.2-1.el8.x86_64.rpm 64 MB/s | 188 kB 00:00 2020-04-02T23:39:14.403 INFO:teuthology.orchestra.run.smithi078.stdout:(62/146): openblas-0.3.3-2.el8.x86_64.rpm 86 MB/s | 4.3 MB 00:00 2020-04-02T23:39:14.454 INFO:teuthology.orchestra.run.smithi078.stdout:(63/146): openblas-threads-0.3.3-2.el8.x86_64.r 85 MB/s | 4.4 MB 00:00 2020-04-02T23:39:14.458 INFO:teuthology.orchestra.run.smithi078.stdout:(64/146): python3-html5lib-0.999999999-6.el8.no 59 MB/s | 214 kB 00:00 2020-04-02T23:39:14.459 INFO:teuthology.orchestra.run.smithi078.stdout:(65/146): python3-jsonpatch-1.21-2.el8.noarch.r 24 MB/s | 27 kB 00:00 2020-04-02T23:39:14.460 INFO:teuthology.orchestra.run.smithi078.stdout:(66/146): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-04-02T23:39:14.479 INFO:teuthology.orchestra.run.smithi078.stdout:(67/146): python3-lxml-4.2.3-1.el8.x86_64.rpm 83 MB/s | 1.5 MB 00:00 2020-04-02T23:39:14.482 INFO:teuthology.orchestra.run.smithi078.stdout:(68/146): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-04-02T23:39:14.483 INFO:teuthology.orchestra.run.smithi078.stdout:(69/146): python3-markupsafe-0.23-19.el8.x86_64 30 MB/s | 39 kB 00:00 2020-04-02T23:39:14.527 INFO:teuthology.orchestra.run.smithi078.stdout:(70/146): python3-numpy-1.14.3-9.el8.x86_64.rpm 86 MB/s | 3.7 MB 00:00 2020-04-02T23:39:14.531 INFO:teuthology.orchestra.run.smithi078.stdout:(71/146): python3-numpy-f2py-1.14.3-9.el8.x86_6 60 MB/s | 225 kB 00:00 2020-04-02T23:39:14.532 INFO:teuthology.orchestra.run.smithi078.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 30 MB/s | 44 kB 00:00 2020-04-02T23:39:14.535 INFO:teuthology.orchestra.run.smithi078.stdout:(73/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 50 MB/s | 126 kB 00:00 2020-04-02T23:39:14.537 INFO:teuthology.orchestra.run.smithi078.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 50 MB/s | 110 kB 00:00 2020-04-02T23:39:14.539 INFO:teuthology.orchestra.run.smithi078.stdout:(75/146): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2020-04-02T23:39:14.725 INFO:teuthology.orchestra.run.smithi078.stdout:(76/146): python3-scipy-1.0.0-20.module_el8.1.0 78 MB/s | 15 MB 00:00 2020-04-02T23:39:14.784 INFO:teuthology.orchestra.run.smithi078.stdout:(77/146): python3-webencodings-0.5.1-6.el8.noar 467 kB/s | 27 kB 00:00 2020-04-02T23:39:14.790 INFO:teuthology.orchestra.run.smithi078.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 71 MB/s | 457 kB 00:00 2020-04-02T23:39:14.797 INFO:teuthology.orchestra.run.smithi078.stdout:(79/146): socat-1.7.3.2-6.el8.x86_64.rpm 43 MB/s | 298 kB 00:00 2020-04-02T23:39:14.798 INFO:teuthology.orchestra.run.smithi078.stdout:(80/146): elfutils-libelf-devel-0.176-5.el8.x86 35 MB/s | 54 kB 00:00 2020-04-02T23:39:14.800 INFO:teuthology.orchestra.run.smithi078.stdout:(81/146): fuse-2.9.7-12.el8.x86_64.rpm 44 MB/s | 82 kB 00:00 2020-04-02T23:39:14.801 INFO:teuthology.orchestra.run.smithi078.stdout:(82/146): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2020-04-02T23:39:14.803 INFO:teuthology.orchestra.run.smithi078.stdout:(83/146): keyutils-libs-devel-1.5.10-6.el8.x86_ 33 MB/s | 48 kB 00:00 2020-04-02T23:39:14.821 INFO:teuthology.orchestra.run.smithi078.stdout:(84/146): krb5-devel-1.17-9.el8.x86_64.rpm 76 MB/s | 548 kB 00:00 2020-04-02T23:39:14.821 INFO:teuthology.orchestra.run.smithi078.stdout:(85/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 17 MB/s | 19 kB 00:00 2020-04-02T23:39:14.821 INFO:teuthology.orchestra.run.smithi078.stdout:(86/146): libcom_err-devel-1.44.6-3.el8.x86_64. 31 MB/s | 38 kB 00:00 2020-04-02T23:39:14.822 INFO:teuthology.orchestra.run.smithi078.stdout:(87/146): libgfortran-8.3.1-4.5.el8.x86_64.rpm 77 MB/s | 638 kB 00:00 2020-04-02T23:39:14.824 INFO:teuthology.orchestra.run.smithi078.stdout:(88/146): libquadmath-8.3.1-4.5.el8.x86_64.rpm 60 MB/s | 169 kB 00:00 2020-04-02T23:39:14.826 INFO:teuthology.orchestra.run.smithi078.stdout:(89/146): librabbitmq-0.9.0-1.el8.x86_64.rpm 34 MB/s | 47 kB 00:00 2020-04-02T23:39:14.829 INFO:teuthology.orchestra.run.smithi078.stdout:(90/146): libselinux-devel-2.9-2.1.el8.x86_64.r 58 MB/s | 199 kB 00:00 2020-04-02T23:39:14.831 INFO:teuthology.orchestra.run.smithi078.stdout:(91/146): libsepol-devel-2.9-1.el8.x86_64.rpm 42 MB/s | 86 kB 00:00 2020-04-02T23:39:14.833 INFO:teuthology.orchestra.run.smithi078.stdout:(92/146): libuuid-devel-2.32.1-17.el8.x86_64.rp 52 MB/s | 95 kB 00:00 2020-04-02T23:39:14.834 INFO:teuthology.orchestra.run.smithi078.stdout:(93/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 16 MB/s | 18 kB 00:00 2020-04-02T23:39:14.838 INFO:teuthology.orchestra.run.smithi078.stdout:(94/146): libxslt-1.1.32-3.el8.x86_64.rpm 65 MB/s | 249 kB 00:00 2020-04-02T23:39:14.866 INFO:teuthology.orchestra.run.smithi078.stdout:(95/146): openssl-devel-1.1.1c-2.el8.x86_64.rpm 84 MB/s | 2.3 MB 00:00 2020-04-02T23:39:14.874 INFO:teuthology.orchestra.run.smithi078.stdout:(96/146): pcre2-devel-10.32-1.el8.x86_64.rpm 77 MB/s | 605 kB 00:00 2020-04-02T23:39:14.878 INFO:teuthology.orchestra.run.smithi078.stdout:(97/146): pcre2-utf16-10.32-1.el8.x86_64.rpm 62 MB/s | 228 kB 00:00 2020-04-02T23:39:14.881 INFO:teuthology.orchestra.run.smithi078.stdout:(98/146): pcre2-utf32-10.32-1.el8.x86_64.rpm 63 MB/s | 220 kB 00:00 2020-04-02T23:39:14.884 INFO:teuthology.orchestra.run.smithi078.stdout:(99/146): python3-chardet-3.0.4-7.el8.noarch.rp 63 MB/s | 195 kB 00:00 2020-04-02T23:39:14.886 INFO:teuthology.orchestra.run.smithi078.stdout:(100/146): python3-jwt-1.6.1-2.el8.noarch.rpm 34 MB/s | 43 kB 00:00 2020-04-02T23:39:14.888 INFO:teuthology.orchestra.run.smithi078.stdout:(101/146): python3-oauthlib-2.1.0-1.el8.noarch. 61 MB/s | 155 kB 00:00 2020-04-02T23:39:14.890 INFO:teuthology.orchestra.run.smithi078.stdout:(102/146): python3-pysocks-1.6.8-3.el8.noarch.r 30 MB/s | 34 kB 00:00 2020-04-02T23:39:14.901 INFO:teuthology.orchestra.run.smithi078.stdout:(103/146): python3-requests-2.20.0-2.1.el8_1.no 56 MB/s | 123 kB 00:00 2020-04-02T23:39:14.901 INFO:teuthology.orchestra.run.smithi078.stdout:(104/146): python3-requests-oauthlib-1.0.0-1.el 32 MB/s | 43 kB 00:00 2020-04-02T23:39:14.901 INFO:teuthology.orchestra.run.smithi078.stdout:(105/146): python3-urllib3-1.24.2-2.el8.noarch. 61 MB/s | 176 kB 00:00 2020-04-02T23:39:14.902 INFO:teuthology.orchestra.run.smithi078.stdout:(106/146): xfsprogs-devel-5.0.0-1.el8.x86_64.rp 41 MB/s | 69 kB 00:00 2020-04-02T23:39:14.902 INFO:teuthology.orchestra.run.smithi078.stdout:(107/146): zlib-devel-1.2.11-10.el8.x86_64.rpm 43 MB/s | 56 kB 00:00 2020-04-02T23:39:14.961 INFO:teuthology.orchestra.run.smithi078.stdout:(108/146): python3-cheroot-8.2.1-1.el8.noarch.r 2.3 MB/s | 145 kB 00:00 2020-04-02T23:39:14.984 INFO:teuthology.orchestra.run.smithi078.stdout:(109/146): python3-cherrypy-18.4.0-1.el8.noarch 17 MB/s | 385 kB 00:00 2020-04-02T23:39:14.997 INFO:teuthology.orchestra.run.smithi078.stdout:(110/146): python3-execnet-1.7.1-1.el8.2.noarch 27 MB/s | 356 kB 00:00 2020-04-02T23:39:15.005 INFO:teuthology.orchestra.run.smithi078.stdout:(111/146): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-02T23:39:15.014 INFO:teuthology.orchestra.run.smithi078.stdout:(112/146): python3-jaraco-functools-2.0-4.el8.n 2.0 MB/s | 18 kB 00:00 2020-04-02T23:39:15.023 INFO:teuthology.orchestra.run.smithi078.stdout:(113/146): python3-logutils-0.3.5-11.el8.noarch 5.4 MB/s | 49 kB 00:00 2020-04-02T23:39:15.032 INFO:teuthology.orchestra.run.smithi078.stdout:(114/146): python3-more-itertools-7.2.0-4.el8.n 6.7 MB/s | 59 kB 00:00 2020-04-02T23:39:15.044 INFO:teuthology.orchestra.run.smithi078.stdout:(115/146): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-02T23:39:15.052 INFO:teuthology.orchestra.run.smithi078.stdout:(116/146): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-02T23:39:15.065 INFO:teuthology.orchestra.run.smithi078.stdout:(117/146): python3-remoto-1.1.4-4.el8.noarch.rp 3.8 MB/s | 48 kB 00:00 2020-04-02T23:39:15.073 INFO:teuthology.orchestra.run.smithi078.stdout:(118/146): python3-repoze-lru-0.7-6.el8.noarch. 4.0 MB/s | 34 kB 00:00 2020-04-02T23:39:15.084 INFO:teuthology.orchestra.run.smithi078.stdout:(119/146): python3-routes-2.4.1-12.el8.noarch.r 18 MB/s | 197 kB 00:00 2020-04-02T23:39:15.092 INFO:teuthology.orchestra.run.smithi078.stdout:(120/146): python3-simplegeneric-0.8.1-17.el8.n 2.3 MB/s | 19 kB 00:00 2020-04-02T23:39:15.101 INFO:teuthology.orchestra.run.smithi078.stdout:(121/146): python3-singledispatch-3.4.0.3-18.el 2.8 MB/s | 24 kB 00:00 2020-04-02T23:39:15.109 INFO:teuthology.orchestra.run.smithi078.stdout:(122/146): python3-tempora-1.14.1-5.el8.noarch. 3.6 MB/s | 30 kB 00:00 2020-04-02T23:39:15.120 INFO:teuthology.orchestra.run.smithi078.stdout:(123/146): python3-trustme-0.5.2-4.el8.noarch.r 2.3 MB/s | 27 kB 00:00 2020-04-02T23:39:15.132 INFO:teuthology.orchestra.run.smithi078.stdout:(124/146): python3-zc-lockfile-2.0-2.el8.noarch 2.7 MB/s | 23 kB 00:00 2020-04-02T23:39:15.221 INFO:teuthology.orchestra.run.smithi078.stdout:(125/146): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-02T23:39:15.237 INFO:teuthology.orchestra.run.smithi078.stdout:(126/146): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-04-02T23:39:15.253 INFO:teuthology.orchestra.run.smithi078.stdout:(127/146): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-04-02T23:39:15.269 INFO:teuthology.orchestra.run.smithi078.stdout:(128/146): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:39:15.286 INFO:teuthology.orchestra.run.smithi078.stdout:(129/146): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-04-02T23:39:15.302 INFO:teuthology.orchestra.run.smithi078.stdout:(130/146): python3-beautifulsoup4-4.6.3-2.el8.1 11 MB/s | 185 kB 00:00 2020-04-02T23:39:15.320 INFO:teuthology.orchestra.run.smithi078.stdout:(131/146): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-04-02T23:39:15.334 INFO:teuthology.orchestra.run.smithi078.stdout:(132/146): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-04-02T23:39:15.350 INFO:teuthology.orchestra.run.smithi078.stdout:(133/146): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-04-02T23:39:15.366 INFO:teuthology.orchestra.run.smithi078.stdout:(134/146): python3-google-auth-1.1.1-10.el8.noa 4.9 MB/s | 81 kB 00:00 2020-04-02T23:39:15.431 INFO:teuthology.orchestra.run.smithi078.stdout:(135/146): python3-kubernetes-10.0.1-2.el8.noar 17 MB/s | 1.1 MB 00:00 2020-04-02T23:39:15.447 INFO:teuthology.orchestra.run.smithi078.stdout:(136/146): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-04-02T23:39:15.464 INFO:teuthology.orchestra.run.smithi078.stdout:(137/146): python3-waitress-1.2.1-2.el8.1.noarc 14 MB/s | 241 kB 00:00 2020-04-02T23:39:15.482 INFO:teuthology.orchestra.run.smithi078.stdout:(138/146): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:39:15.498 INFO:teuthology.orchestra.run.smithi078.stdout:(139/146): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-04-02T23:39:15.514 INFO:teuthology.orchestra.run.smithi078.stdout:(140/146): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-04-02T23:39:15.530 INFO:teuthology.orchestra.run.smithi078.stdout:(141/146): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-04-02T23:39:15.542 INFO:teuthology.orchestra.run.smithi078.stdout:(142/146): leveldb-1.21-2.el8.x86_64.rpm 41 MB/s | 179 kB 00:00 2020-04-02T23:39:16.514 INFO:teuthology.orchestra.run.smithi078.stdout:(143/146): librados2-16.0.0-316.gcbb84f7.el8.x8 3.7 MB/s | 3.6 MB 00:00 2020-04-02T23:39:16.921 INFO:teuthology.orchestra.run.smithi078.stdout:(144/146): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 4.8 MB/s | 2.0 MB 00:00 2020-04-02T23:39:23.593 INFO:teuthology.orchestra.run.smithi078.stdout:(145/146): ceph-test-debuginfo-16.0.0-316.gcbb8 10 MB/s | 1.0 GB 01:45 2020-04-02T23:39:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:(146/146): rbd-mirror-debuginfo-16.0.0-316.gcbb 4.7 MB/s | 84 MB 00:17 2020-04-02T23:39:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:39:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:Total 13 MB/s | 3.0 GB 03:59 2020-04-02T23:39:24.322 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2020-04-02T23:39:24.448 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2020-04-02T23:39:24.448 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2020-04-02T23:39:36.271 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2020-04-02T23:39:36.272 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2020-04-02T23:39:50.390 INFO:teuthology.orchestra.run.smithi190.stdout:(146/146): ceph-test-debuginfo-16.0.0-316.gcbb8 7.9 MB/s | 1.0 GB 02:14 2020-04-02T23:39:50.393 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:39:50.393 INFO:teuthology.orchestra.run.smithi190.stdout:Total 12 MB/s | 3.0 GB 04:25 2020-04-02T23:39:50.454 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2020-04-02T23:39:50.583 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2020-04-02T23:39:50.583 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2020-04-02T23:39:52.047 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2020-04-02T23:39:52.261 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/148 2020-04-02T23:39:52.465 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/148 2020-04-02T23:39:52.651 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/148 2020-04-02T23:39:53.086 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/148 2020-04-02T23:39:53.319 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:39:53.562 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:39:53.801 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/148 2020-04-02T23:39:53.907 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/148 2020-04-02T23:39:54.067 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:39:54.180 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:39:54.375 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/148 2020-04-02T23:39:54.567 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/148 2020-04-02T23:39:54.902 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/148 2020-04-02T23:39:55.084 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/148 2020-04-02T23:39:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/148 2020-04-02T23:39:55.452 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/148 2020-04-02T23:39:55.609 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/148 2020-04-02T23:39:55.716 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/148 2020-04-02T23:39:55.920 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/148 2020-04-02T23:39:56.090 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/148 2020-04-02T23:39:56.277 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/148 2020-04-02T23:39:56.458 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/148 2020-04-02T23:39:56.688 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/148 2020-04-02T23:39:56.808 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/148 2020-04-02T23:39:56.985 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/148 2020-04-02T23:39:57.159 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/148 2020-04-02T23:39:57.708 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/148 2020-04-02T23:39:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/148 2020-04-02T23:39:58.511 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/148 2020-04-02T23:39:58.708 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/148 2020-04-02T23:39:59.416 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/148 2020-04-02T23:39:59.735 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/148 2020-04-02T23:39:59.913 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/148 2020-04-02T23:40:00.076 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/148 2020-04-02T23:40:00.318 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/148 2020-04-02T23:40:00.558 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/148 2020-04-02T23:40:02.410 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2020-04-02T23:40:02.411 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2020-04-02T23:40:02.527 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/148 2020-04-02T23:40:02.827 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/148 2020-04-02T23:40:03.052 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/148 2020-04-02T23:40:03.281 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/148 2020-04-02T23:40:03.496 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/148 2020-04-02T23:40:03.711 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/148 2020-04-02T23:40:03.915 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/148 2020-04-02T23:40:04.109 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/148 2020-04-02T23:40:04.285 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/148 2020-04-02T23:40:04.561 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/148 2020-04-02T23:40:04.749 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/148 2020-04-02T23:40:04.939 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/148 2020-04-02T23:40:05.172 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/148 2020-04-02T23:40:05.403 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/148 2020-04-02T23:40:05.635 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/148 2020-04-02T23:40:05.872 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/148 2020-04-02T23:40:06.121 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/148 2020-04-02T23:40:06.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/148 2020-04-02T23:40:06.550 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/148 2020-04-02T23:40:06.769 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/148 2020-04-02T23:40:07.024 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/148 2020-04-02T23:40:07.215 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/148 2020-04-02T23:40:07.374 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-04-02T23:40:07.556 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/148 2020-04-02T23:40:07.703 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/148 2020-04-02T23:40:07.851 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/148 2020-04-02T23:40:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/148 2020-04-02T23:40:08.293 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/148 2020-04-02T23:40:08.449 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/148 2020-04-02T23:40:08.622 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/148 2020-04-02T23:40:08.813 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/148 2020-04-02T23:40:09.031 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/148 2020-04-02T23:40:09.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/148 2020-04-02T23:40:09.490 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/148 2020-04-02T23:40:09.720 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/148 2020-04-02T23:40:09.895 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/148 2020-04-02T23:40:10.908 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/148 2020-04-02T23:40:11.135 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/148 2020-04-02T23:40:11.351 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/148 2020-04-02T23:40:11.641 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/148 2020-04-02T23:40:11.817 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/148 2020-04-02T23:40:11.997 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/148 2020-04-02T23:40:12.162 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/148 2020-04-02T23:40:12.451 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/148 2020-04-02T23:40:12.627 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/148 2020-04-02T23:40:12.843 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/148 2020-04-02T23:40:13.079 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/148 2020-04-02T23:40:13.276 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/148 2020-04-02T23:40:13.277 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/148 2020-04-02T23:40:13.277 INFO:teuthology.orchestra.run.smithi078.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:40:13.277 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:40:13.691 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/148 2020-04-02T23:40:13.882 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/148 2020-04-02T23:40:14.166 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/148 2020-04-02T23:40:14.384 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/148 2020-04-02T23:40:14.771 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/148 2020-04-02T23:40:15.079 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/148 2020-04-02T23:40:15.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/148 2020-04-02T23:40:15.476 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/148 2020-04-02T23:40:15.653 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/148 2020-04-02T23:40:15.940 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/148 2020-04-02T23:40:16.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/148 2020-04-02T23:40:16.423 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/148 2020-04-02T23:40:16.685 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/148 2020-04-02T23:40:17.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/148 2020-04-02T23:40:17.354 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/148 2020-04-02T23:40:17.588 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/148 2020-04-02T23:40:17.767 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/148 2020-04-02T23:40:17.967 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/148 2020-04-02T23:40:17.976 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2020-04-02T23:40:18.046 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/148 2020-04-02T23:40:18.156 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/148 2020-04-02T23:40:18.360 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/148 2020-04-02T23:40:18.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.5-12.el8.x86_64 92/148 2020-04-02T23:40:18.558 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/148 2020-04-02T23:40:18.649 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.1-6.el8.noarch 93/148 2020-04-02T23:40:18.772 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/148 2020-04-02T23:40:18.948 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/148 2020-04-02T23:40:18.992 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/148 2020-04-02T23:40:19.161 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:40:19.181 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/148 2020-04-02T23:40:19.388 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:40:19.608 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/148 2020-04-02T23:40:19.710 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/148 2020-04-02T23:40:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:40:19.964 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:40:20.199 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/148 2020-04-02T23:40:20.349 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/148 2020-04-02T23:40:20.703 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/148 2020-04-02T23:40:20.874 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/148 2020-04-02T23:40:20.979 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/148 2020-04-02T23:40:21.202 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/148 2020-04-02T23:40:21.357 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/148 2020-04-02T23:40:21.475 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/148 2020-04-02T23:40:21.678 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/148 2020-04-02T23:40:21.835 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/148 2020-04-02T23:40:22.017 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/148 2020-04-02T23:40:22.224 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/148 2020-04-02T23:40:22.481 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/148 2020-04-02T23:40:22.607 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/148 2020-04-02T23:40:22.745 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/148 2020-04-02T23:40:22.773 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:22.949 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/148 2020-04-02T23:40:23.064 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:23.519 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/148 2020-04-02T23:40:23.699 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/148 2020-04-02T23:40:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:24.064 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/148 2020-04-02T23:40:24.155 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/148 2020-04-02T23:40:24.241 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/148 2020-04-02T23:40:24.289 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/148 2020-04-02T23:40:24.425 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/148 2020-04-02T23:40:25.133 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/148 2020-04-02T23:40:25.440 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/148 2020-04-02T23:40:25.637 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/148 2020-04-02T23:40:25.758 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/148 2020-04-02T23:40:26.002 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/148 2020-04-02T23:40:26.215 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/148 2020-04-02T23:40:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/148 2020-04-02T23:40:28.484 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/148 2020-04-02T23:40:28.694 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/148 2020-04-02T23:40:28.942 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/148 2020-04-02T23:40:29.162 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/148 2020-04-02T23:40:29.368 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/148 2020-04-02T23:40:29.571 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/148 2020-04-02T23:40:29.746 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/148 2020-04-02T23:40:29.917 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/148 2020-04-02T23:40:30.212 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/148 2020-04-02T23:40:30.409 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/148 2020-04-02T23:40:30.588 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/148 2020-04-02T23:40:30.795 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/148 2020-04-02T23:40:31.026 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/148 2020-04-02T23:40:31.291 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/148 2020-04-02T23:40:31.521 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/148 2020-04-02T23:40:31.760 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/148 2020-04-02T23:40:32.034 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/148 2020-04-02T23:40:32.233 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/148 2020-04-02T23:40:32.475 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/148 2020-04-02T23:40:32.688 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/148 2020-04-02T23:40:32.864 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/148 2020-04-02T23:40:33.090 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-04-02T23:40:33.271 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/148 2020-04-02T23:40:33.418 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/148 2020-04-02T23:40:33.600 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/148 2020-04-02T23:40:33.801 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/148 2020-04-02T23:40:33.992 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/148 2020-04-02T23:40:34.167 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/148 2020-04-02T23:40:34.337 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/148 2020-04-02T23:40:34.545 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/148 2020-04-02T23:40:34.788 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/148 2020-04-02T23:40:35.002 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/148 2020-04-02T23:40:35.292 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/148 2020-04-02T23:40:35.529 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/148 2020-04-02T23:40:35.742 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/148 2020-04-02T23:40:36.796 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/148 2020-04-02T23:40:37.058 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/148 2020-04-02T23:40:37.233 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/148 2020-04-02T23:40:37.518 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/148 2020-04-02T23:40:37.765 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/148 2020-04-02T23:40:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/148 2020-04-02T23:40:38.077 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/148 2020-04-02T23:40:38.381 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/148 2020-04-02T23:40:38.584 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/148 2020-04-02T23:40:38.792 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/148 2020-04-02T23:40:39.020 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/148 2020-04-02T23:40:39.224 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/148 2020-04-02T23:40:39.224 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/148 2020-04-02T23:40:39.225 INFO:teuthology.orchestra.run.smithi190.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:40:39.225 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:40:39.633 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/148 2020-04-02T23:40:39.797 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/148 2020-04-02T23:40:40.095 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/148 2020-04-02T23:40:40.302 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/148 2020-04-02T23:40:40.443 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/148 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2020-04-02T23:40:40.444 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2020-04-02T23:40:40.445 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2020-04-02T23:40:40.445 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2020-04-02T23:40:40.445 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2020-04-02T23:40:40.445 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:40:40.740 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/148 2020-04-02T23:40:40.845 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/148 2020-04-02T23:40:40.992 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/148 2020-04-02T23:40:41.243 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/148 2020-04-02T23:40:41.252 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/148 2020-04-02T23:40:41.432 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/148 2020-04-02T23:40:41.626 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/148 2020-04-02T23:40:41.645 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/148 2020-04-02T23:40:41.921 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/148 2020-04-02T23:40:42.188 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/148 2020-04-02T23:40:42.393 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/148 2020-04-02T23:40:42.651 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/148 2020-04-02T23:40:43.037 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/148 2020-04-02T23:40:43.083 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/148 2020-04-02T23:40:43.311 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/148 2020-04-02T23:40:43.336 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/148 2020-04-02T23:40:43.477 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/148 2020-04-02T23:40:43.856 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/148 2020-04-02T23:40:44.057 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/148 2020-04-02T23:40:44.237 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/148 2020-04-02T23:40:44.322 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/148 2020-04-02T23:40:44.600 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.5-12.el8.x86_64 92/148 2020-04-02T23:40:44.668 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/148 2020-04-02T23:40:44.810 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/148 2020-04-02T23:40:44.876 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.1-6.el8.noarch 93/148 2020-04-02T23:40:44.994 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/148 2020-04-02T23:40:45.011 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/148 2020-04-02T23:40:45.197 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/148 2020-04-02T23:40:45.412 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/148 2020-04-02T23:40:45.846 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/148 2020-04-02T23:40:46.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/148 2020-04-02T23:40:47.116 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/148 2020-04-02T23:40:47.343 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/148 2020-04-02T23:40:47.412 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/148 2020-04-02T23:40:47.794 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/148 2020-04-02T23:40:48.053 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/148 2020-04-02T23:40:48.084 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/148 2020-04-02T23:40:48.277 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/148 2020-04-02T23:40:48.290 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/148 2020-04-02T23:40:48.904 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:49.299 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:49.306 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/148 2020-04-02T23:40:49.485 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/148 2020-04-02T23:40:49.837 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/148 2020-04-02T23:40:49.989 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/148 2020-04-02T23:40:50.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/148 2020-04-02T23:40:50.277 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/148 2020-04-02T23:40:50.338 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/148 2020-04-02T23:40:50.481 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/148 2020-04-02T23:40:54.015 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/148 2020-04-02T23:40:54.361 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/148 2020-04-02T23:40:54.576 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/148 2020-04-02T23:40:54.637 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/148 2020-04-02T23:40:55.560 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/148 2020-04-02T23:40:55.832 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/148 2020-04-02T23:40:56.012 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/148 2020-04-02T23:40:56.187 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/148 2020-04-02T23:40:56.308 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/148 2020-04-02T23:40:56.568 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/148 2020-04-02T23:40:56.754 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/148 2020-04-02T23:40:56.976 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/148 2020-04-02T23:40:57.001 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/148 2020-04-02T23:40:57.292 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/148 2020-04-02T23:40:58.129 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/148 2020-04-02T23:40:58.218 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/148 2020-04-02T23:40:58.473 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/148 2020-04-02T23:40:58.713 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/148 2020-04-02T23:41:06.739 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/148 2020-04-02T23:41:06.739 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2020-04-02T23:41:06.739 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /run 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2020-04-02T23:41:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2020-04-02T23:41:06.741 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:41:07.101 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/148 2020-04-02T23:41:07.365 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 126/148 2020-04-02T23:41:07.504 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/148 2020-04-02T23:41:07.734 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/148 2020-04-02T23:41:07.742 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 127/148 2020-04-02T23:41:07.972 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 128/148 2020-04-02T23:41:08.288 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8. 129/148 2020-04-02T23:41:08.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8. 130/148 2020-04-02T23:41:08.790 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el 131/148 2020-04-02T23:41:09.166 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/148 2020-04-02T23:41:09.367 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/148 2020-04-02T23:41:09.391 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/148 2020-04-02T23:41:11.138 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/148 2020-04-02T23:41:11.311 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/148 2020-04-02T23:41:11.500 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/148 2020-04-02T23:41:12.344 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/148 2020-04-02T23:41:12.616 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/148 2020-04-02T23:41:13.667 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/148 2020-04-02T23:41:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/148 2020-04-02T23:41:13.969 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/148 2020-04-02T23:41:14.339 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/148 2020-04-02T23:41:14.579 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/148 2020-04-02T23:41:14.607 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/148 2020-04-02T23:41:14.782 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/148 2020-04-02T23:41:14.796 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/148 2020-04-02T23:41:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.e 132/148 2020-04-02T23:41:15.814 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/148 2020-04-02T23:41:15.975 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/148 2020-04-02T23:41:16.296 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/148 2020-04-02T23:41:16.674 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/148 2020-04-02T23:41:20.651 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/148 2020-04-02T23:41:20.987 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/148 2020-04-02T23:41:21.173 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/148 2020-04-02T23:41:21.234 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/148 2020-04-02T23:41:22.107 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/148 2020-04-02T23:41:23.061 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/148 2020-04-02T23:41:23.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 133/148 2020-04-02T23:41:23.227 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/148 2020-04-02T23:41:23.409 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/148 2020-04-02T23:41:23.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 134/148 2020-04-02T23:41:23.572 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/148 2020-04-02T23:41:23.796 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/148 2020-04-02T23:41:24.001 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/148 2020-04-02T23:41:24.173 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/148 2020-04-02T23:41:24.198 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/148 2020-04-02T23:41:24.408 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/148 2020-04-02T23:41:24.606 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.e 135/148 2020-04-02T23:41:24.648 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/148 2020-04-02T23:41:24.742 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/148 2020-04-02T23:41:24.948 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/148 2020-04-02T23:41:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/148 2020-04-02T23:41:33.918 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 126/148 2020-04-02T23:41:34.262 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 127/148 2020-04-02T23:41:34.457 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 128/148 2020-04-02T23:41:34.749 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8. 129/148 2020-04-02T23:41:35.022 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8. 130/148 2020-04-02T23:41:35.259 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el 131/148 2020-04-02T23:41:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.e 132/148 2020-04-02T23:41:49.785 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 133/148 2020-04-02T23:41:49.942 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 134/148 2020-04-02T23:41:51.108 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.e 135/148 2020-04-02T23:43:09.446 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 136/148 2020-04-02T23:43:38.259 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 136/148 2020-04-02T23:43:43.719 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 137/148 2020-04-02T23:44:09.781 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 137/148 2020-04-02T23:44:16.075 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8 138/148 2020-04-02T23:44:26.987 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 139/148 2020-04-02T23:44:30.869 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 140/148 2020-04-02T23:44:41.295 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 141/148 2020-04-02T23:44:41.786 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 142/148 2020-04-02T23:44:43.113 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:16.0.0-3 143/148 2020-04-02T23:44:44.915 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8 138/148 2020-04-02T23:44:55.357 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 139/148 2020-04-02T23:44:59.213 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 140/148 2020-04-02T23:45:09.487 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 141/148 2020-04-02T23:45:10.025 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 142/148 2020-04-02T23:45:11.335 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:16.0.0-3 143/148 2020-04-02T23:45:41.434 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 144/148 2020-04-02T23:45:54.016 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8. 145/148 2020-04-02T23:45:54.313 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 146/148 2020-04-02T23:45:54.313 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/148 2020-04-02T23:45:54.580 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/148 2020-04-02T23:45:54.581 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:45:57.087 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:45:57.087 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/148 2020-04-02T23:45:57.087 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 3/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8. 5/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 7/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 8/148 2020-04-02T23:45:57.088 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:16.0.0-3 9/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 10/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 11/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 12/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 13/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 14/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 15/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 16/148 2020-04-02T23:45:57.089 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 17/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 18/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8 19/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 20/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 21/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 22/148 2020-04-02T23:45:57.090 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 23/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 24/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 25/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 26/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 27/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.e 28/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 29/148 2020-04-02T23:45:57.091 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 30/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 31/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 32/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 33/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 34/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 35/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.e 36/148 2020-04-02T23:45:57.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 37/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el 38/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 39/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8. 40/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 41/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8. 42/148 2020-04-02T23:45:57.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 43/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 44/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 45/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 46/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 47/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 48/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 49/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 50/148 2020-04-02T23:45:57.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 51/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 52/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 53/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 54/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 55/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.1-6.el8.noarch 56/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 57/148 2020-04-02T23:45:57.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 58/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.5-12.el8.x86_64 59/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 60/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 61/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 62/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 63/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 64/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 65/148 2020-04-02T23:45:57.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 66/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 67/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 68/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 69/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 70/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 71/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 72/148 2020-04-02T23:45:57.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 73/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 75/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 76/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 77/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 78/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 79/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 80/148 2020-04-02T23:45:57.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 81/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 82/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 83/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 84/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 85/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 86/148 2020-04-02T23:45:57.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 87/148 2020-04-02T23:45:57.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 88/148 2020-04-02T23:45:57.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 89/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 90/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 91/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 92/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 93/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 94/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 95/148 2020-04-02T23:45:57.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 96/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 97/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 98/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 99/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 100/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 101/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 102/148 2020-04-02T23:45:57.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 103/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 104/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 105/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 106/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 107/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 108/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 109/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 110/148 2020-04-02T23:45:57.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 111/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 112/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 113/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 114/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 115/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 116/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 117/148 2020-04-02T23:45:57.104 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 118/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 119/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 120/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 121/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 122/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 123/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 124/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 125/148 2020-04-02T23:45:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 127/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 128/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 129/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 130/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 131/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 132/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 133/148 2020-04-02T23:45:57.106 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 134/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 135/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 136/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 137/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 138/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 139/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 140/148 2020-04-02T23:45:57.107 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 141/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 142/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 143/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : leveldb-1.21-2.el8.x86_64 144/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 145/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 146/148 2020-04-02T23:45:57.108 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 147/148 2020-04-02T23:45:58.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:45:58.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:45:58.895 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2020-04-02T23:45:58.895 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.895 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.896 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.897 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.898 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.899 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.900 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.901 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:45:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.904 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.904 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.904 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.904 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.909 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.909 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.909 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:45:58.910 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:45:58.911 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:45:58.912 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:45:58.913 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:45:58.914 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:45:58.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:45:58.916 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:45:58.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:45:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:45:58.919 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:45:58.920 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:45:58.923 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:45:58.923 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:45:58.923 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:45:58.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:45:58.923 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2020-04-02T23:45:59.616 DEBUG:teuthology.parallel:result is None 2020-04-02T23:46:09.483 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 144/148 2020-04-02T23:46:22.205 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8. 145/148 2020-04-02T23:46:22.507 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 146/148 2020-04-02T23:46:22.508 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/148 2020-04-02T23:46:22.838 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/148 2020-04-02T23:46:22.838 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:46:25.197 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:46:25.197 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/148 2020-04-02T23:46:25.197 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/148 2020-04-02T23:46:25.197 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 3/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 4/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8. 5/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 6/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 7/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 8/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:16.0.0-3 9/148 2020-04-02T23:46:25.198 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 10/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 11/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 12/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 13/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 14/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 15/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 16/148 2020-04-02T23:46:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 17/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 18/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8 19/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 20/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 21/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 22/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 23/148 2020-04-02T23:46:25.200 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 24/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 25/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 26/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 27/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.e 28/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x8 29/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 30/148 2020-04-02T23:46:25.201 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 31/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 32/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 33/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 34/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 35/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.e 36/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 37/148 2020-04-02T23:46:25.202 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el 38/148 2020-04-02T23:46:25.203 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 39/148 2020-04-02T23:46:25.203 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8. 40/148 2020-04-02T23:46:25.203 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 41/148 2020-04-02T23:46:25.203 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8. 42/148 2020-04-02T23:46:25.203 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 43/148 2020-04-02T23:46:25.204 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86 44/148 2020-04-02T23:46:25.204 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 45/148 2020-04-02T23:46:25.204 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x 46/148 2020-04-02T23:46:25.204 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 47/148 2020-04-02T23:46:25.204 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_ 48/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 49/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 50/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 51/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 52/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 53/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 54/148 2020-04-02T23:46:25.205 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 55/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.1-6.el8.noarch 56/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.0.4-10.el8.x86_64 57/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.1-9.el8.x86_64 58/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.5-12.el8.x86_64 59/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 60/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 61/148 2020-04-02T23:46:25.206 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 62/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 63/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 64/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 65/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 66/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 67/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 68/148 2020-04-02T23:46:25.207 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 69/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 70/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 71/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 72/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 73/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/148 2020-04-02T23:46:25.208 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 75/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 76/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 77/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 78/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 79/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 80/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 81/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 82/148 2020-04-02T23:46:25.209 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 83/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 84/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 85/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 86/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 87/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 88/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 89/148 2020-04-02T23:46:25.210 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 90/148 2020-04-02T23:46:25.211 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 91/148 2020-04-02T23:46:25.211 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 92/148 2020-04-02T23:46:25.211 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 93/148 2020-04-02T23:46:25.211 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 94/148 2020-04-02T23:46:25.211 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 95/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 96/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 97/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 98/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 99/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 100/148 2020-04-02T23:46:25.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 101/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 102/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 103/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 104/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 105/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 106/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 107/148 2020-04-02T23:46:25.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 108/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 109/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 110/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 111/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 112/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 113/148 2020-04-02T23:46:25.214 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 114/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 115/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 116/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 117/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-2.6-1.el8.noarch 118/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 119/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 120/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 121/148 2020-04-02T23:46:25.215 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 122/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 123/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 124/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 125/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 127/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 128/148 2020-04-02T23:46:25.216 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 129/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 130/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 131/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 132/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 133/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 134/148 2020-04-02T23:46:25.217 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 135/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 136/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 137/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 138/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 139/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 140/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 141/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 142/148 2020-04-02T23:46:25.218 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 143/148 2020-04-02T23:46:25.219 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : leveldb-1.21-2.el8.x86_64 144/148 2020-04-02T23:46:25.219 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 145/148 2020-04-02T23:46:25.219 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 146/148 2020-04-02T23:46:25.219 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 147/148 2020-04-02T23:46:26.888 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 148/148 2020-04-02T23:46:26.888 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:26.888 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2020-04-02T23:46:26.888 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.889 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.890 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.891 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.892 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.893 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.894 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-debuginfo-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:46:26.895 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:46:26.896 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:46:26.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:46:26.899 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:46:26.900 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:46:26.901 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:46:26.901 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:46:26.901 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:46:26.901 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:46:26.901 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:46:26.902 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:46:26.903 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:46:26.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:46:26.905 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:46:26.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:46:26.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:46:26.908 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:46:26.909 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:46:26.910 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:46:26.911 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:46:26.911 INFO:teuthology.orchestra.run.smithi190.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:46:26.911 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:26.911 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2020-04-02T23:46:27.597 DEBUG:teuthology.parallel:result is None 2020-04-02T23:46:27.598 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:27.613 INFO:teuthology.orchestra.run.smithi190:> sudo lsb_release -is 2020-04-02T23:46:27.697 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS 2020-04-02T23:46:27.698 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:46:27.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:46:27.934 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:27.948 INFO:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:46:28.007 INFO:teuthology.orchestra.run.smithi190.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:46:28.007 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:46:28.007 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:46:28.008 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:28.026 INFO:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2020-04-02T23:46:28.117 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS 2020-04-02T23:46:28.119 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:46:28.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:46:28.350 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:28.366 INFO:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:46:28.428 INFO:teuthology.orchestra.run.smithi078.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:46:28.428 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:46:28.428 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:46:28.428 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-02T23:46:28.429 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:28.442 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:46:28.512 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:28.528 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:46:28.601 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-02T23:46:28.601 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:28.615 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:46:28.683 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:28.736 INFO:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:46:28.803 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:28.819 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:46:28.892 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:28.947 INFO:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:46:29.017 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-02T23:46:29.017 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:29.031 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:46:29.117 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:29.170 INFO:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:46:29.237 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:29.253 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:46:29.339 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:29.394 INFO:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:46:29.463 INFO:teuthology.run_tasks:Running task ceph... 2020-04-02T23:46:29.533 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-02T23:46:29.533 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:29.548 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2020-04-02T23:46:29.590 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:29.606 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2020-04-02T23:46:29.678 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-02T23:46:29.678 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:29.692 INFO:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:46:29.735 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:29.752 INFO:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:46:29.825 INFO:tasks.ceph:Creating extra log directories... 2020-04-02T23:46:29.825 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:29.840 INFO:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:46:29.883 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:29.898 INFO:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:46:29.970 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-04-02T23:46:29.970 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-04-02T23:46:29.970 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-04-02T23:46:29.970 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:30.026 INFO:teuthology.orchestra.run.smithi190:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:46:30.110 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:30.166 INFO:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:30.287 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:30.301 INFO:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:30.407 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:30.421 INFO:teuthology.orchestra.run.smithi078:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:46:30.506 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:30.560 INFO:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:30.671 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:30.685 INFO:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:30.752 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-02T23:46:30.753 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow requests are blocked'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds heartbeat grace': 60, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'osd heartbeat grace': 40}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd fast shutdown': False, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1, 'mon op complaint time': 120}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}} 2020-04-02T23:46:30.753 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'debuginfo': True, 'flavor': 'notcmalloc', 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2759', 'owner': 'scheduled_gregf@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi190.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLUyIJgU4iI1/whmPy6m1GrKcojp80NKMbFXwqIZaavMnNE+0WXr3eszbTchleNUMITMvesmPN0IRwQ7YDE9BQnHj4/gq2PHohcdtL3J8UdRvs08CT4mzvIMgiOTxhmeCqEOxdvAg5L+OfIj2TpQHP/yWP1zBqB2dnJ34Vdr3KshDze+ik0idOkFcq6cHbzsGEdzLDUr97eCgrBTuQFyx/DRHAgwMzez/zom84SV3x52Ht7EQiEdppSRJEyo98vNhF4TGAndhc/NCjw8hFtUux2RnLRglyF77jy7eWgetjUuiekUPkgrUNPwZkftOQ25WGqgP4KbjGYzD89EdLWdMWbLGO4j40o0ndC/k60fBktxeFinC32QRCBBNnbH0TQLvzJbRrmehZ34dLCCGnJcqibnWHV7574qdGGcf7DxCBQWNC8O3/mewqTfLZjRjQjwemLF693Z5NqeGBQ47jt8RYD3tFXzK41QV5axA79rgXGuVbkAVMyFx03O0zeX6of70=', 'smithi078.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7Sdx6AcOOtVT3P9DOCtzWKGLQbNigoZA5MCa+6UIMuSQVze103ln85M+qbk0uMnb1iE131YtGqOEO3FPpBXwW2VuOAmsynyfgp+uS/zMey0nT4yRTGGFpMKkvPYb79rmCZoX2PmFeIgruYOywUZhuVG+pyQEjo7ugS4fAKYn3ALMjE1qxrdPe8FDgEAApHKn9oufik8rUYAngsuDHq+FWqBmxoX5OL6LCvB2DO0537HOhinwMlrx8+7rQiKU8SR4txn2Ye3R+HJLP9KXKNmrChQT26QKymbSqA5w1bFyWEUY1rI9xXsfYT8ig53dLidyjxLEMRHfPv+ZrO5IrqkZur1DpRbaQdw4X2Vr+O4yRQZgVZ6+TPw8UCcgI2TJqJsKTKqnWf/Oq4r1kOmyOHegzQvWenNlNRo9bTCozD8loxzhhnaQutq6ln09Incltnb7C2AmR14kukGHiZKeTaWj8KT6Gg1VEbVkkRayzM18TQS8kI+1vG+cMEK19+2ZeE+0='}, 'job_id': '4919148', 'tube': 'smithi', 'suite_branch': 'wip-greg-testing-42', 'priority': 101, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-greg-testing-42', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'gfarnum@redhat.com', 'archive_path': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919148', 'description': 'fs/verify/{begin.yaml centos_latest.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'name': 'gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'overrides': {'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'workunit': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'branch': 'wip-greg-testing-42'}, 'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow requests are blocked'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds heartbeat grace': 60, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'osd heartbeat grace': 40}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd fast shutdown': False, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1, 'mon op complaint time': 120}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'notcmalloc', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, 'admin_socket': {'branch': 'wip-greg-testing-42'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}, 'os_type': 'centos', 'suite_sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:46:30.753 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:30.805 INFO:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:46:30.848 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:30.864 INFO:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:46:30.920 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:30.933 INFO:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:46:30.976 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:30.993 INFO:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:46:31.122 DEBUG:teuthology.orchestra.remote:smithi190:/scratch_devs is 72B 2020-04-02T23:46:31.174 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:46:31.174 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:31.189 INFO:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:46:31.245 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:46:31.245 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.245 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 55140 Links: 1 2020-04-02T23:46:31.245 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.245 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.246 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2020-04-02 23:46:24.856960670 +0000 2020-04-02T23:46:31.246 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2020-04-02 23:35:02.977018457 +0000 2020-04-02T23:46:31.246 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2020-04-02 23:35:02.977018457 +0000 2020-04-02T23:46:31.246 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2020-04-02T23:46:31.259 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2020-04-02T23:46:31.260 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2020-04-02T23:46:31.260 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000201236 s, 2.5 MB/s 2020-04-02T23:46:31.263 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:31.319 INFO:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:46:31.376 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:46:31.376 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 58179 Links: 1 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2020-04-02 23:46:24.856960670 +0000 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2020-04-02 23:35:03.363007770 +0000 2020-04-02T23:46:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2020-04-02 23:35:03.363007770 +0000 2020-04-02T23:46:31.378 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2020-04-02T23:46:31.392 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2020-04-02T23:46:31.392 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2020-04-02T23:46:31.392 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000195746 s, 2.6 MB/s 2020-04-02T23:46:31.396 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:31.451 INFO:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:46:31.506 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:46:31.506 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.506 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 57005 Links: 1 2020-04-02T23:46:31.507 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.507 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.507 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2020-04-02 23:46:24.856960670 +0000 2020-04-02T23:46:31.507 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2020-04-02 23:35:03.751997002 +0000 2020-04-02T23:46:31.508 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2020-04-02 23:35:03.751997002 +0000 2020-04-02T23:46:31.508 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2020-04-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2020-04-02T23:46:31.520 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2020-04-02T23:46:31.520 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000206442 s, 2.5 MB/s 2020-04-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:31.577 INFO:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:46:31.632 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:46:31.632 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.633 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 60213 Links: 1 2020-04-02T23:46:31.633 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.633 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.633 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2020-04-02 23:46:24.856960670 +0000 2020-04-02T23:46:31.634 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2020-04-02 23:35:04.087987700 +0000 2020-04-02T23:46:31.634 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2020-04-02 23:35:04.087987700 +0000 2020-04-02T23:46:31.634 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2020-04-02T23:46:31.645 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2020-04-02T23:46:31.646 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2020-04-02T23:46:31.646 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000221348 s, 2.3 MB/s 2020-04-02T23:46:31.648 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:31.669 DEBUG:teuthology.orchestra.remote:smithi078:/scratch_devs is 72B 2020-04-02T23:46:31.718 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:46:31.718 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:31.732 INFO:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 61338 Links: 1 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.788 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2020-04-02 23:45:55.893029425 +0000 2020-04-02T23:46:31.789 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2020-04-02 23:35:02.937472508 +0000 2020-04-02T23:46:31.789 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2020-04-02 23:35:02.937472508 +0000 2020-04-02T23:46:31.789 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2020-04-02T23:46:31.802 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2020-04-02T23:46:31.802 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2020-04-02T23:46:31.802 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000224831 s, 2.3 MB/s 2020-04-02T23:46:31.805 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:31.860 INFO:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:46:31.915 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:46:31.915 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:31.915 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 64163 Links: 1 2020-04-02T23:46:31.915 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:31.916 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:31.916 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2020-04-02 23:45:55.894029408 +0000 2020-04-02T23:46:31.916 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2020-04-02 23:35:03.331465550 +0000 2020-04-02T23:46:31.916 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2020-04-02 23:35:03.331465550 +0000 2020-04-02T23:46:31.916 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2020-04-02T23:46:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2020-04-02T23:46:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2020-04-02T23:46:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000205605 s, 2.5 MB/s 2020-04-02T23:46:31.931 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:31.985 INFO:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:46:32.039 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:46:32.039 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 64232 Links: 1 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2020-04-02 23:45:55.894029408 +0000 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2020-04-02 23:35:03.703458980 +0000 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2020-04-02 23:35:03.703458980 +0000 2020-04-02T23:46:32.040 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2020-04-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2020-04-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2020-04-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000204535 s, 2.5 MB/s 2020-04-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:32.122 INFO:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:46:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:46:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:46:32.332 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 67594 Links: 1 2020-04-02T23:46:32.332 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:46:32.332 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:46:32.333 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2020-04-02 23:45:55.894029408 +0000 2020-04-02T23:46:32.333 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2020-04-02 23:35:04.053452800 +0000 2020-04-02T23:46:32.333 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2020-04-02 23:35:04.053452800 +0000 2020-04-02T23:46:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2020-04-02T23:46:32.346 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2020-04-02T23:46:32.346 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2020-04-02T23:46:32.346 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000292141 s, 1.8 MB/s 2020-04-02T23:46:32.349 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:32.349 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:46:32.349 INFO:tasks.ceph:Generating config... 2020-04-02T23:46:32.350 INFO:tasks.ceph:[mds] mds debug frag = True 2020-04-02T23:46:32.350 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-04-02T23:46:32.350 INFO:tasks.ceph:[mds] mds heartbeat grace = 60 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] debug mds = 20 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] debug ms = 1 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds bal frag = True 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-04-02T23:46:32.351 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-04-02T23:46:32.352 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-04-02T23:46:32.352 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-04-02T23:46:32.352 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2020-04-02T23:46:32.352 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-02T23:46:32.352 INFO:tasks.ceph:[osd] debug ms = 1 2020-04-02T23:46:32.352 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-02T23:46:32.352 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-02T23:46:32.352 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-02T23:46:32.353 INFO:tasks.ceph:[osd] osd fast shutdown = False 2020-04-02T23:46:32.354 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-02T23:46:32.354 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-02T23:46:32.354 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-02T23:46:32.354 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-04-02T23:46:32.354 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-02T23:46:32.354 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-02T23:46:32.354 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2020-04-02T23:46:32.354 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-02T23:46:32.355 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-04-02T23:46:32.355 INFO:tasks.ceph:[client] debug ms = 1 2020-04-02T23:46:32.355 INFO:tasks.ceph:[client] debug client = 20 2020-04-02T23:46:32.355 INFO:tasks.ceph:[client] client mount timeout = 600 2020-04-02T23:46:32.355 INFO:tasks.ceph:Setting up mon.a... 2020-04-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:32.371 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-02T23:46:32.944 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.keyring 2020-04-02T23:46:32.946 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:32.959 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-02T23:46:33.039 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.093 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:46:33.159 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.190'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]'), ('mon.b', '172.21.15.78')] 2020-04-02T23:46:33.159 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.212 INFO:teuthology.orchestra.run.smithi190:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.190 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --add b 172.21.15.78 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:33.288 INFO:teuthology.orchestra.run.smithi190.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:33.288 INFO:teuthology.orchestra.run.smithi190.stdout:monmaptool: generated fsid 01f4b530-6799-492e-8606-c311ffa25289 2020-04-02T23:46:33.288 INFO:teuthology.orchestra.run.smithi190.stdout:epoch 0 2020-04-02T23:46:33.288 INFO:teuthology.orchestra.run.smithi190.stdout:fsid 01f4b530-6799-492e-8606-c311ffa25289 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:last_changed 2020-04-02T23:46:33.287487+0000 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:created 2020-04-02T23:46:33.287487+0000 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:min_mon_release 0 (unknown) 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:0: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.a 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.b 2020-04-02T23:46:33.289 INFO:teuthology.orchestra.run.smithi190.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2020-04-02T23:46:33.290 INFO:teuthology.orchestra.run.smithi190.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-02T23:46:33.291 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 01f4b530-6799-492e-8606-c311ffa25289... 2020-04-02T23:46:33.292 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:33.308 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:46:33.351 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.364 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:46:33.408 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2020-04-02T23:46:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2020-04-02T23:46:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:46:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:46:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2020-04-02T23:46:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2020-04-02T23:46:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.190,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.78" 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: osd heartbeat grace = 40 2020-04-02T23:46:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 01f4b530-6799-492e-8606-c311ffa25289 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2020-04-02T23:46:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2020-04-02T23:46:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2020-04-02T23:46:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2020-04-02T23:46:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2020-04-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 25 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2020-04-02T23:46:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: debug journal = 20 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: osd fast shutdown = False 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: debug filestore = 20 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2020-04-02T23:46:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2020-04-02T23:46:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2020-04-02T23:46:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2020-04-02T23:46:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd crush smoke test = False 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2020-04-02T23:46:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2020-04-02T23:46:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2020-04-02T23:46:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:46:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:46:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2020-04-02T23:46:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2020-04-02T23:46:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split bits = 3 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: mds heartbeat grace = 60 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split size = 100 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2020-04-02T23:46:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal merge size = 5 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal frag = True 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal fragment size max = 10000 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2020-04-02T23:46:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2020-04-02T23:46:33.456 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2020-04-02T23:46:33.456 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.457 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2020-04-02T23:46:33.458 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:46:33.459 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.460 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2020-04-02T23:46:33.460 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.460 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2020-04-02T23:46:33.460 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2020-04-02T23:46:33.461 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:46:33.461 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:46:33.461 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2020-04-02T23:46:33.461 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:46:33.461 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.462 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.190,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.78" 2020-04-02T23:46:33.463 INFO:teuthology.orchestra.run.smithi190.stdout: osd heartbeat grace = 40 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 01f4b530-6799-492e-8606-c311ffa25289 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2020-04-02T23:46:33.464 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2020-04-02T23:46:33.465 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.467 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2020-04-02T23:46:33.468 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2020-04-02T23:46:33.468 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2020-04-02T23:46:33.468 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2020-04-02T23:46:33.469 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2020-04-02T23:46:33.469 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 25 2020-04-02T23:46:33.469 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore compression mode = aggressive 2020-04-02T23:46:33.469 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2020-04-02T23:46:33.469 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: debug journal = 20 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2020-04-02T23:46:33.470 INFO:teuthology.orchestra.run.smithi190.stdout: osd fast shutdown = False 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: debug filestore = 20 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2020-04-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2020-04-02T23:46:33.472 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2020-04-02T23:46:33.473 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd crush smoke test = False 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:46:33.474 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2020-04-02T23:46:33.475 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2020-04-02T23:46:33.476 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2020-04-02T23:46:33.476 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2020-04-02T23:46:33.476 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2020-04-02T23:46:33.476 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split bits = 3 2020-04-02T23:46:33.477 INFO:teuthology.orchestra.run.smithi190.stdout: mds heartbeat grace = 60 2020-04-02T23:46:33.486 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split size = 100 2020-04-02T23:46:33.486 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2020-04-02T23:46:33.486 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal merge size = 5 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal frag = True 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal fragment size max = 10000 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2020-04-02T23:46:33.487 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2020-04-02T23:46:33.488 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2020-04-02T23:46:33.489 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-02T23:46:33.489 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.502 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-02T23:46:33.593 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-02T23:46:33.609 DEBUG:teuthology.orchestra.remote:smithi190:/etc/ceph/ceph.keyring is 206B 2020-04-02T23:46:33.703 DEBUG:teuthology.orchestra.remote:smithi190:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-02T23:46:33.751 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:46:33.751 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.764 INFO:teuthology.orchestra.run.smithi190:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:46:33.868 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:33.916 INFO:teuthology.orchestra.run.smithi190:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:34.000 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:46:34.001 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:34.018 INFO:teuthology.orchestra.run.smithi078:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:46:34.119 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:34.174 INFO:teuthology.orchestra.run.smithi078:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:34.259 INFO:tasks.ceph:Setting up mon nodes... 2020-04-02T23:46:34.259 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-02T23:46:34.259 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:34.272 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:46:34.365 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:46:34.368 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:34.382 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:46:34.490 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:46:34.492 INFO:tasks.ceph:Setting up mds nodes... 2020-04-02T23:46:34.493 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:34.506 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:46:34.598 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:46:34.600 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:34.613 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-04-02T23:46:34.680 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:34.696 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:46:34.794 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:46:34.795 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:34.811 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-04-02T23:46:34.879 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-02T23:46:34.880 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:34.893 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-02T23:46:34.973 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-02T23:46:34.988 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-02T23:46:34.989 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:46:34.989 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:35.044 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:35.110 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:35.110 INFO:tasks.ceph:role: osd.0 2020-04-02T23:46:35.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:46:35.110 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:35.162 INFO:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:35.723 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:35.724 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:35.724 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:35.724 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:35.724 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:35.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2020-04-02T23:46:35.725 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:35.739 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:35.880 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:35.895 INFO:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:35.966 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:36.019 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:36.086 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:36.086 INFO:tasks.ceph:role: osd.1 2020-04-02T23:46:36.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:46:36.087 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:36.139 INFO:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:46:36.653 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:36.653 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:36.653 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:36.653 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:36.654 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:36.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2020-04-02T23:46:36.655 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:36.689 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:36.807 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:36.836 INFO:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:36.909 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:36.967 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:37.038 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:37.038 INFO:tasks.ceph:role: osd.2 2020-04-02T23:46:37.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:46:37.038 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:37.092 INFO:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:46:37.633 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:37.633 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:37.633 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:37.633 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:37.634 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:37.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2020-04-02T23:46:37.635 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:37.651 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:37.809 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:37.822 INFO:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:37.892 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:37.945 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:38.011 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:38.011 INFO:tasks.ceph:role: osd.3 2020-04-02T23:46:38.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2020-04-02T23:46:38.012 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:38.064 INFO:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:46:38.609 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:38.610 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:38.610 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:38.610 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2020-04-02T23:46:38.610 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:38.610 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:38.611 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:38.611 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:38.611 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:38.611 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:38.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2020-04-02T23:46:38.612 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:38.626 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:38.729 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:38.742 INFO:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:38.813 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:38.867 INFO:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:38.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.963+0000 7f0f84244ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-02T23:46:38.968 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.966+0000 7f0f84244ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-02T23:46:38.968 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.966+0000 7f0f84244ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:38.969 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.966+0000 7f0f84244ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:38.969 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.966+0000 7f0f84244ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:46:38.969 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:38.968+0000 7f0f84244ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-02T23:46:41.309 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:41.324 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-02T23:46:41.395 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:41.453 INFO:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:41.541 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.537+0000 7f12d426cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-02T23:46:41.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.538+0000 7f12d426cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-02T23:46:41.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.538+0000 7f12d426cec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:41.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.538+0000 7f12d426cec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:41.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.538+0000 7f12d426cec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:46:41.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:41.538+0000 7f12d426cec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-02T23:46:43.887 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:43.904 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-02T23:46:43.973 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:44.028 INFO:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:44.114 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-02T23:46:44.114 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-02T23:46:44.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:44.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:44.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:46:44.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:44.112+0000 7f65378a4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-02T23:46:46.466 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:46.481 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-02T23:46:46.550 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:46.605 INFO:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:46.693 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.690+0000 7f84c3bc5ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-02T23:46:46.693 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.691+0000 7f84c3bc5ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-02T23:46:46.693 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.691+0000 7f84c3bc5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:46.693 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.691+0000 7f84c3bc5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:46.693 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.691+0000 7f84c3bc5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:46:46.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:46:46.691+0000 7f84c3bc5ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-02T23:46:49.031 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:46:49.046 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-02T23:46:49.117 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:49.134 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-02T23:46:49.206 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:49.206 INFO:tasks.ceph:role: osd.4 2020-04-02T23:46:49.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:46:49.207 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:49.261 INFO:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:46:49.792 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:49.793 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:49.793 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:49.793 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2020-04-02T23:46:49.793 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:49.793 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:49.794 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:49.794 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:49.794 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:49.794 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:49.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2020-04-02T23:46:49.795 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:49.813 INFO:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-02T23:46:49.962 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:49.976 INFO:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-02T23:46:50.049 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:50.103 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-02T23:46:50.172 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:50.172 INFO:tasks.ceph:role: osd.5 2020-04-02T23:46:50.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:46:50.172 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:50.226 INFO:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:46:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:50.744 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:50.744 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:50.745 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:50.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2020-04-02T23:46:50.747 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:50.761 INFO:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-02T23:46:50.870 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:50.884 INFO:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-02T23:46:50.954 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:51.009 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-02T23:46:51.076 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:51.076 INFO:tasks.ceph:role: osd.6 2020-04-02T23:46:51.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:46:51.077 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:51.129 INFO:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:46:51.648 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:51.648 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:51.648 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:51.648 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:51.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2020-04-02T23:46:51.650 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:51.664 INFO:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-02T23:46:51.786 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:51.800 INFO:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-02T23:46:51.870 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:51.924 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-02T23:46:51.990 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:46:51.991 INFO:tasks.ceph:role: osd.7 2020-04-02T23:46:51.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2020-04-02T23:46:51.991 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:46:52.567 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:46:52.567 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:46:52.567 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:46:52.567 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:46:52.568 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:46:52.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2020-04-02T23:46:52.569 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:52.583 INFO:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-02T23:46:52.686 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-02T23:46:52.769 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:52.822 INFO:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:52.906 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.904+0000 7ff2b3682ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-02T23:46:52.909 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.908+0000 7ff2b3682ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-02T23:46:52.910 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.908+0000 7ff2b3682ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:46:52.910 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.908+0000 7ff2b3682ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:46:52.910 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.908+0000 7ff2b3682ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:46:52.910 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:52.909+0000 7ff2b3682ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-02T23:46:55.250 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:55.306 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-02T23:46:55.377 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:55.432 INFO:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:55.519 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.517+0000 7f3232af7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-02T23:46:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.518+0000 7f3232af7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-02T23:46:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.518+0000 7f3232af7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.518+0000 7f3232af7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.518+0000 7f3232af7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:46:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:55.518+0000 7f3232af7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-02T23:46:57.866 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:57.882 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-02T23:46:57.954 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:46:58.009 INFO:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:46:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.094+0000 7f092efdeec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-02T23:46:58.097 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.095+0000 7f092efdeec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-02T23:46:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.095+0000 7f092efdeec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.095+0000 7f092efdeec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.095+0000 7f092efdeec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:46:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:46:58.095+0000 7f092efdeec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-02T23:47:00.439 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:00.455 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-02T23:47:00.527 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:00.583 INFO:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:47:00.676 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.673+0000 7fd5974d9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-02T23:47:00.676 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.674+0000 7fd5974d9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-02T23:47:00.677 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.674+0000 7fd5974d9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:47:00.677 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.674+0000 7fd5974d9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:47:00.677 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.674+0000 7fd5974d9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:47:00.677 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:00.674+0000 7fd5974d9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-02T23:47:00.754 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:00.768 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:00.810 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:00.826 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:03.012 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:03.030 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-02T23:47:03.101 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-02T23:47:03.102 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.118 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:03.175 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.MQmuDZj4tL 2020-04-02T23:47:03.176 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.231 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.MQmuDZj4tL 2020-04-02T23:47:03.303 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.358 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.MQmuDZj4tL 2020-04-02T23:47:03.484 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.MQmuDZj4tL is 56B 2020-04-02T23:47:03.532 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.547 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.MQmuDZj4tL 2020-04-02T23:47:03.600 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.653 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:03.707 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.2gtRsHxNvB 2020-04-02T23:47:03.708 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.763 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.2gtRsHxNvB 2020-04-02T23:47:03.836 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:03.908 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.2gtRsHxNvB 2020-04-02T23:47:04.092 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.2gtRsHxNvB is 56B 2020-04-02T23:47:04.157 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.172 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.2gtRsHxNvB 2020-04-02T23:47:04.232 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.288 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:04.342 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.Z2j8Ciq7qS 2020-04-02T23:47:04.343 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.397 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.Z2j8Ciq7qS 2020-04-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.519 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.Z2j8Ciq7qS 2020-04-02T23:47:04.645 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.Z2j8Ciq7qS is 56B 2020-04-02T23:47:04.670 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.683 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.Z2j8Ciq7qS 2020-04-02T23:47:04.737 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.791 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:04.846 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.X0M8UqssHE 2020-04-02T23:47:04.847 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:04.902 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.X0M8UqssHE 2020-04-02T23:47:04.971 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.025 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.X0M8UqssHE 2020-04-02T23:47:05.148 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.X0M8UqssHE is 56B 2020-04-02T23:47:05.195 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.209 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.X0M8UqssHE 2020-04-02T23:47:05.261 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:05.367 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.CQa6EnwN4E 2020-04-02T23:47:05.368 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.421 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.CQa6EnwN4E 2020-04-02T23:47:05.488 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.541 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.CQa6EnwN4E 2020-04-02T23:47:05.665 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.CQa6EnwN4E is 56B 2020-04-02T23:47:05.713 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.725 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.CQa6EnwN4E 2020-04-02T23:47:05.779 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.832 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:05.885 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.kABdrphVys 2020-04-02T23:47:05.886 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:05.939 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.kABdrphVys 2020-04-02T23:47:06.005 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:06.059 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.kABdrphVys 2020-04-02T23:47:06.181 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.kABdrphVys is 56B 2020-04-02T23:47:06.233 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:06.246 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.kABdrphVys 2020-04-02T23:47:06.299 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.315 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:06.370 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.D9OXQ3JBKI 2020-04-02T23:47:06.371 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.425 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.D9OXQ3JBKI 2020-04-02T23:47:06.496 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.557 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.D9OXQ3JBKI 2020-04-02T23:47:06.685 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.D9OXQ3JBKI is 56B 2020-04-02T23:47:06.737 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.751 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.D9OXQ3JBKI 2020-04-02T23:47:06.806 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.861 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:06.916 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Xhns6fO18b 2020-04-02T23:47:06.916 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:06.971 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.Xhns6fO18b 2020-04-02T23:47:07.039 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.093 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.Xhns6fO18b 2020-04-02T23:47:07.224 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.Xhns6fO18b is 56B 2020-04-02T23:47:07.271 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.285 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.Xhns6fO18b 2020-04-02T23:47:07.338 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.393 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:07.447 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.V1LmmqhW9z 2020-04-02T23:47:07.447 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.500 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.V1LmmqhW9z 2020-04-02T23:47:07.567 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.620 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.V1LmmqhW9z 2020-04-02T23:47:07.753 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.V1LmmqhW9z is 56B 2020-04-02T23:47:07.801 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.814 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.V1LmmqhW9z 2020-04-02T23:47:07.867 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:07.920 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:07.973 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.0iaJOCXDwm 2020-04-02T23:47:07.973 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.031 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.0iaJOCXDwm 2020-04-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.155 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.0iaJOCXDwm 2020-04-02T23:47:08.277 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.0iaJOCXDwm is 56B 2020-04-02T23:47:08.325 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.338 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.0iaJOCXDwm 2020-04-02T23:47:08.390 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.443 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:08.496 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.q3SPOYc7RK 2020-04-02T23:47:08.496 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.549 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.q3SPOYc7RK 2020-04-02T23:47:08.615 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.668 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.q3SPOYc7RK 2020-04-02T23:47:08.792 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.q3SPOYc7RK is 56B 2020-04-02T23:47:08.842 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.855 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.q3SPOYc7RK 2020-04-02T23:47:08.908 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:08.961 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:09.015 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.AdiEUue6yv 2020-04-02T23:47:09.015 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.AdiEUue6yv 2020-04-02T23:47:09.135 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.188 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.AdiEUue6yv 2020-04-02T23:47:09.310 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.AdiEUue6yv is 56B 2020-04-02T23:47:09.357 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.370 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.AdiEUue6yv 2020-04-02T23:47:09.443 DEBUG:teuthology.orchestra.remote:smithi190:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-02T23:47:09.491 INFO:tasks.ceph:Adding keys to all mons... 2020-04-02T23:47:09.491 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.504 INFO:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:47:09.547 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:09.563 INFO:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaeYZeLk7DFRAATg8OWo2nWks0OJ3Gj1g7Mw== 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaeYZeeKOWIxAATm8L7KTyEpWnOo++DxzP4Q== 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2020-04-02T23:47:09.606 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBeeYZec/6DORAAwGFtxknQVEah7PZ2se/ACQ== 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBheYZeOVkdIBAAS7kMb/0PUHIkuyvgMFtSXA== 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBkeYZelu+9BhAAENsn1WYhksaoINuYPzDYuA== 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBmeYZe07c6KRAAoRlHCbaTP/WYIPbinorzdg== 2020-04-02T23:47:09.607 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaeYZepBwuHRAAkSate8jl40NnA/5+QNLIsA== 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaeYZeGXk1LxAA/VyDEcu4kCJd+4pwDvIHTg== 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBseYZebzr0NRAAEom7Tq2og/ge0+oIp3WVrA== 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2020-04-02T23:47:09.608 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBveYZeSeziHhAAo/hK1m/hTikdRGbFUJd9Nw== 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQByeYZe6Nu8BRAAaRZS8mlIGSUb9oAtmnoZpw== 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB0eYZecL5AKBAAVy05pTD+DkpqJTDek+fcbQ== 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2020-04-02T23:47:09.609 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaeYZesUL2ORAAXkFN3oTF9bQqcY3Gd7M3Jw== 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaeYZeLk7DFRAATg8OWo2nWks0OJ3Gj1g7Mw== 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaeYZeeKOWIxAATm8L7KTyEpWnOo++DxzP4Q== 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2020-04-02T23:47:09.632 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBeeYZec/6DORAAwGFtxknQVEah7PZ2se/ACQ== 2020-04-02T23:47:09.633 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2020-04-02T23:47:09.633 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBheYZeOVkdIBAAS7kMb/0PUHIkuyvgMFtSXA== 2020-04-02T23:47:09.633 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2020-04-02T23:47:09.633 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBkeYZelu+9BhAAENsn1WYhksaoINuYPzDYuA== 2020-04-02T23:47:09.633 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBmeYZe07c6KRAAoRlHCbaTP/WYIPbinorzdg== 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaeYZepBwuHRAAkSate8jl40NnA/5+QNLIsA== 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaeYZeGXk1LxAA/VyDEcu4kCJd+4pwDvIHTg== 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBseYZebzr0NRAAEom7Tq2og/ge0+oIp3WVrA== 2020-04-02T23:47:09.634 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBveYZeSeziHhAAo/hK1m/hTikdRGbFUJd9Nw== 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQByeYZe6Nu8BRAAaRZS8mlIGSUb9oAtmnoZpw== 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQB0eYZecL5AKBAAVy05pTD+DkpqJTDek+fcbQ== 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2020-04-02T23:47:09.635 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaeYZesUL2ORAAXkFN3oTF9bQqcY3Gd7M3Jw== 2020-04-02T23:47:09.637 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.663 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:47:09.705 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:09.730 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:47:09.823 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:09.836 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:47:09.878 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:09.893 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:47:09.986 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.004 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.043 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.056 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.145 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.159 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.201 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.215 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.304 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.330 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.372 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.385 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.473 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.486 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.528 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.541 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.630 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.644 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:47:10.686 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.701 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:47:10.789 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.803 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.845 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:10.859 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:47:10.948 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:10.961 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.003 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.020 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.105 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:11.119 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.162 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.176 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.264 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:11.278 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.319 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.333 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.421 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:11.434 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.476 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.490 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:47:11.579 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:11.593 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:47:11.635 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.649 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:47:11.740 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-02T23:47:11.740 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.753 INFO:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-02T23:47:11.821 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.877 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:47:11.972 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:11.985 INFO:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-02T23:47:12.051 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.065 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-02T23:47:12.132 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.186 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:47:12.280 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.293 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-02T23:47:12.360 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.413 INFO:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-02T23:47:12.481 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.534 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:47:12.629 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.642 INFO:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-02T23:47:12.709 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.762 INFO:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:47:12.804 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:12.820 INFO:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:47:12.875 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-02T23:47:12.876 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2020-04-02T23:47:12.876 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-02T23:47:12.876 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:12.931 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2020-04-02T23:47:12.973 INFO:tasks.ceph.mon.a:Started 2020-04-02T23:47:12.973 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2020-04-02T23:47:12.974 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-02T23:47:12.974 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:12.987 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2020-04-02T23:47:13.029 INFO:tasks.ceph.mon.b:Started 2020-04-02T23:47:13.029 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2020-04-02T23:47:13.030 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-02T23:47:13.030 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:13.043 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2020-04-02T23:47:13.085 INFO:tasks.ceph.mon.c:Started 2020-04-02T23:47:13.085 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-02T23:47:13.086 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-02T23:47:13.086 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:13.100 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2020-04-02T23:47:13.142 INFO:tasks.ceph.mgr.y:Started 2020-04-02T23:47:13.142 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-02T23:47:13.143 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:13.158 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2020-04-02T23:47:13.201 INFO:tasks.ceph.mgr.x:Started 2020-04-02T23:47:13.201 INFO:tasks.ceph:Setting crush tunables to default 2020-04-02T23:47:13.201 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:13.216 INFO:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd crush tunables default 2020-04-02T23:47:19.923 INFO:tasks.ceph.mon.a.smithi190.stderr:==00:00:00:06.834 23565== Warning: unimplemented fcntl command: 1036 2020-04-02T23:47:20.195 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:00:07.045 24216== Warning: unimplemented fcntl command: 1036 2020-04-02T23:47:20.211 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:00:07.064 24202== Warning: unimplemented fcntl command: 1036 2020-04-02T23:47:24.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.361+0000 7f1c44864700 1 Processor -- start 2020-04-02T23:47:24.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.361+0000 7f1c44864700 1 -- start start 2020-04-02T23:47:24.352 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c44864700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c400a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c44864700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a7d00 con 0x7f1c4005b750 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c44864700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a6140 con 0x7f1c4014dc40 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c44864700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c400a6b20 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c4014dc40 legacy=0x7f1c40150060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c4005b750 legacy=0x7f1c400a4690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c3e59c700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c400a7490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.362+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c400a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.563+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c4014dc40 legacy=0x7f1c40150060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.563+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c4005b750 legacy=0x7f1c400a4690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.563+0000 7f1c3e59c700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c400a7490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.563+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c400a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.964+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c4014dc40 legacy=0x7f1c40150060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.964+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c4005b750 legacy=0x7f1c400a4690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.964+0000 7f1c3e59c700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c400a7490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:13.964+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c400a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c400a7490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c400a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c4014dc40 legacy=0x7f1c40150060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c4005b750 legacy=0x7f1c400a4690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c20003380 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3cd99700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200088f0 con 0x7f1c20005d60 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 msgr2=0x7f1c20005850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 msgr2=0x7f1c20008270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.362+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.563+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 msgr2=0x7f1c20005850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.563+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.563+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 msgr2=0x7f1c20008270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.563+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.964+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 msgr2=0x7f1c20005850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.964+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 msgr2=0x7f1c20008270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.964+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:14.964+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:15.765+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 msgr2=0x7f1c20005850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:15.765+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:15.765+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 msgr2=0x7f1c20008270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:15.765+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:47:24.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 msgr2=0x7f1c20008270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20005d60 0x7f1c20008270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 msgr2=0x7f1c20005850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20003380 0x7f1c20005850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3f59e700 1 -- reap_dead start 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a6680 con 0x7f1c20003d90 2020-04-02T23:47:24.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c400a6b20 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3cd99700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200088f0 con 0x7f1c20006260 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3e59c700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 msgr2=0x7f1c20003840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c2000ac80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.362+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.563+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.563+0000 7f1c3e59c700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 msgr2=0x7f1c20003840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.563+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.563+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c2000ac80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.563+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.964+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.964+0000 7f1c3e59c700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 msgr2=0x7f1c20003840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.964+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c2000ac80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.964+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:17.964+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:18.765+0000 7f1c3f59e700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:18.765+0000 7f1c3e59c700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 msgr2=0x7f1c20003840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2020-04-02T23:47:24.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:18.765+0000 7f1c3ed9d700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c2000ac80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:18.765+0000 7f1c3e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:18.765+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 msgr2=0x7f1c20003840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1c20006260 0x7f1c20003840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 -- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 msgr2=0x7f1c2000ac80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c400a6b20 0x7f1c2000ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.363 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.362+0000 7f1c3cd99700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.363+0000 7f1c3cd99700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a7d00 con 0x7f1c2000d0f0 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.363+0000 7f1c3cd99700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c20010c30 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.363+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c2000d0f0 legacy=0x7f1c2000f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.363+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.363+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.364 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.564+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c2000d0f0 legacy=0x7f1c2000f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.564+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.564+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.965+0000 7f1c3ed9d700 1 -- >> v1:172.21.15.78:6789/0 conn(0x7f1c2000d0f0 legacy=0x7f1c2000f510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.965+0000 7f1c3e59c700 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:20.965+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.771+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.771+0000 7f1c3e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:45870/0 (socket says 172.21.15.190:45870) 2020-04-02T23:47:24.365 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.771+0000 7f1c3e59c700 1 -- 172.21.15.190:0/1560193182 learned_addr learned my addr 172.21.15.190:0/1560193182 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.774+0000 7f1c3e59c700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.774+0000 7f1c3e59c700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.774+0000 7f1c3e59c700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:21.774+0000 7f1c3e59c700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 msgr2=0x7f1c20013050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20010c30 0x7f1c20013050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 -- 172.21.15.190:0/1560193182 >> v1:172.21.15.78:6789/0 conn(0x7f1c2000d0f0 legacy=0x7f1c2000f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 reap_dead start 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 -- 172.21.15.190:0/1560193182 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a6680 con 0x7f1c20003840 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 -- 172.21.15.190:0/1560193182 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a6140 con 0x7f1c20003d90 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3cd99700 1 -- 172.21.15.190:0/1560193182 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c20008270 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.363+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.364+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2000ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.364+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2000ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.364+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.364+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.652+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.801+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2000ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.801+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2000ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.801+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:47:24.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.801+0000 7f1c3f59e700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.975+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237375584 0 0) 0x7f1c400a6680 con 0x7f1c20003840 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:23.975+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c2c003230 con 0x7f1c20003840 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.010+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519253887 0 0) 0x7f1c400a6140 con 0x7f1c20003d90 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.010+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c400a6680 con 0x7f1c20003d90 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1197624169 0 0) 0x7f1c2c003230 con 0x7f1c20003840 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2000ac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:47:24.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2000ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 >> v1:172.21.15.190:6789/0 conn(0x7f1c20003d90 legacy=0x7f1c20004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20013180 con 0x7f1c20003840 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 588050524 0 0) 0x7f1c300080e0 con 0x7f1c20003840 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 >> v1:172.21.15.78:6789/0 conn(0x7f1c20003840 legacy=0x7f1c20013660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c2c003d40 0x7f1c2c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c004930 0x7f1c2c004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:24.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400a63e0 con 0x7f1c2c004930 2020-04-02T23:47:24.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0051d0 con 0x7f1c2c003d40 2020-04-02T23:47:24.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.043+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c005390 con 0x7f1c20008270 2020-04-02T23:47:24.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.094+0000 7f1c3e59c700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c2c003d40 0x7f1c2c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.100+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c2c003d40 msgr2=0x7f1c2c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c2c003d40 0x7f1c2c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c004930 msgr2=0x7f1c2c004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c004930 0x7f1c2c004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/1560193182 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c003230 con 0x7f1c20008270 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.108+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c28003910 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.111+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c28003910 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.111+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f1c28003910 tx=0x7f1c28007cc0).ready entity=mon.2 client_cookie=cba077f479c82b89 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f1c28003910 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f1c28003910 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c28003e80 con 0x7f1c20008270 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f1c28003910 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c28008dc0 con 0x7f1c20008270 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3dd9b700 1 -- 172.21.15.190:0/1560193182 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c280107f0 con 0x7f1c20008270 2020-04-02T23:47:24.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c44864700 1 -- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 msgr2=0x7f1c2c0038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c44864700 1 --2- 172.21.15.190:0/1560193182 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c20008270 0x7f1c2c0038e0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f1c28003910 tx=0x7f1c28007cc0).stop 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.151+0000 7f1c3f59e700 1 -- 172.21.15.190:0/1560193182 reap_dead start 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.152+0000 7f1c44864700 1 -- 172.21.15.190:0/1560193182 shutdown_connections 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.152+0000 7f1c44864700 1 -- 172.21.15.190:0/1560193182 >> 172.21.15.190:0/1560193182 conn(0x7f1c400ab4f0 msgr2=0x7f1c400ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.152+0000 7f1c44864700 1 -- 172.21.15.190:0/1560193182 shutdown_connections 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.152+0000 7f1c44864700 1 -- 172.21.15.190:0/1560193182 wait complete. 2020-04-02T23:47:24.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.153+0000 7f1c44864700 1 Processor -- start 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.153+0000 7f1c44864700 1 -- start start 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c44864700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c40122550 0x7f1c400a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c44864700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c400a1900 0x7f1c401328b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c44864700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a0ac0 con 0x7f1c40132d10 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c44864700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400a0d60 con 0x7f1c40122550 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c44864700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400a1000 con 0x7f1c400a1900 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c3f59e700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f1c40132d10 0x7f1c40135900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53274/0 (socket says 172.21.15.190:53274) 2020-04-02T23:47:24.375 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.154+0000 7f1c3f59e700 1 -- 172.21.15.190:0/4176212357 learned_addr learned my addr 172.21.15.190:0/4176212357 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.160+0000 7f1c3e59c700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c400a1900 0x7f1c401328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.160+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> v2:172.21.15.78:3300/0 conn(0x7f1c40122550 0x7f1c400a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.176+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c400a1900 msgr2=0x7f1c401328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.176+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c400a1900 0x7f1c401328b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.176+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/4176212357 >> v1:172.21.15.190:6789/0 conn(0x7f1c40132d10 legacy=0x7f1c40135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.176+0000 7f1c3ed9d700 1 -- 172.21.15.190:0/4176212357 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400a1d10 con 0x7f1c40122550 2020-04-02T23:47:24.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.177+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> v2:172.21.15.78:3300/0 conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.180+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> v2:172.21.15.78:3300/0 conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.180+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.186+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.186+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.186+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.186+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c28007260 con 0x7f1c40122550 2020-04-02T23:47:24.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.187+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c280073c0 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.187+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c28007720 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.187+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c40133120 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.187+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c40136250 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.188+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c40056ec0 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.213+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.213+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.213+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7f1c280044b0 con 0x7f1c40122550 2020-04-02T23:47:24.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.213+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f1c28004d20 con 0x7f1c40122550 2020-04-02T23:47:24.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.362+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.362+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f1c28004740 con 0x7f1c40122550 2020-04-02T23:47:24.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.446+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1c40069c00 con 0x7f1c40122550 2020-04-02T23:47:24.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.598+0000 7f1c3ed9d700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:24.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.598+0000 7f1c377fe700 1 -- 172.21.15.190:0/4176212357 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1c2800a860 con 0x7f1c40122550 2020-04-02T23:47:24.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 msgr2=0x7f1c400a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1c400ab400 tx=0x7f1c28007cc0).stop 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 shutdown_connections 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c40122550 0x7f1c400a14a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 --2- 172.21.15.190:0/4176212357 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c400a1900 0x7f1c401328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 >> 172.21.15.190:0/4176212357 conn(0x7f1c400ab4f0 msgr2=0x7f1c4006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 shutdown_connections 2020-04-02T23:47:24.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:47:24.599+0000 7f1c44864700 1 -- 172.21.15.190:0/4176212357 wait complete. 2020-04-02T23:47:24.603 INFO:teuthology.orchestra.run.smithi190.stderr:adjusted tunables profile to default 2020-04-02T23:47:24.611 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-02T23:47:24.611 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:24.626 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:24.679 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.86NHUdPylE 2020-04-02T23:47:24.680 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:24.733 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.86NHUdPylE 2020-04-02T23:47:24.803 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:24.857 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.86NHUdPylE 2020-04-02T23:47:24.982 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.86NHUdPylE is 37B 2020-04-02T23:47:25.029 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.042 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.86NHUdPylE 2020-04-02T23:47:25.102 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.153 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.f7NN8UBHGZ 2020-04-02T23:47:25.207 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.309 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.f7NN8UBHGZ 2020-04-02T23:47:25.336 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.390 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.f7NN8UBHGZ 2020-04-02T23:47:25.513 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.f7NN8UBHGZ is 37B 2020-04-02T23:47:25.560 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.573 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.f7NN8UBHGZ 2020-04-02T23:47:25.627 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.681 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:25.734 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.ls0rkM6LQj 2020-04-02T23:47:25.735 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.788 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.ls0rkM6LQj 2020-04-02T23:47:25.857 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:25.911 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.ls0rkM6LQj 2020-04-02T23:47:26.034 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.ls0rkM6LQj is 37B 2020-04-02T23:47:26.081 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:26.094 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.ls0rkM6LQj 2020-04-02T23:47:26.148 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:26.201 INFO:teuthology.orchestra.run.smithi190:> mktemp 2020-04-02T23:47:26.259 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.8vU9we03C1 2020-04-02T23:47:26.260 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:26.313 INFO:teuthology.orchestra.run.smithi190:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.8vU9we03C1 2020-04-02T23:47:26.380 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:26.433 INFO:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.8vU9we03C1 2020-04-02T23:47:26.557 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.8vU9we03C1 is 37B 2020-04-02T23:47:26.605 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:26.620 INFO:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.8vU9we03C1 2020-04-02T23:47:26.672 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:26.685 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:26.739 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.X4upEmfQPx 2020-04-02T23:47:26.739 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:26.793 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.X4upEmfQPx 2020-04-02T23:47:26.861 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:26.921 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.X4upEmfQPx 2020-04-02T23:47:27.040 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.X4upEmfQPx is 37B 2020-04-02T23:47:27.091 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.104 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.X4upEmfQPx 2020-04-02T23:47:27.158 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.211 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:27.266 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.4gmwZdcvde 2020-04-02T23:47:27.267 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.326 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.4gmwZdcvde 2020-04-02T23:47:27.388 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.445 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.4gmwZdcvde 2020-04-02T23:47:27.572 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.4gmwZdcvde is 37B 2020-04-02T23:47:27.642 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.660 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.4gmwZdcvde 2020-04-02T23:47:27.716 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Lzoenr1s5i 2020-04-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:27.882 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.Lzoenr1s5i 2020-04-02T23:47:27.955 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.011 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.Lzoenr1s5i 2020-04-02T23:47:28.142 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.Lzoenr1s5i is 37B 2020-04-02T23:47:28.206 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.219 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.Lzoenr1s5i 2020-04-02T23:47:28.272 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.324 INFO:teuthology.orchestra.run.smithi078:> mktemp 2020-04-02T23:47:28.378 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.bo5CAAmVHq 2020-04-02T23:47:28.378 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.433 INFO:teuthology.orchestra.run.smithi078:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.bo5CAAmVHq 2020-04-02T23:47:28.502 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.555 INFO:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.bo5CAAmVHq 2020-04-02T23:47:28.683 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.bo5CAAmVHq is 37B 2020-04-02T23:47:28.733 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.747 INFO:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.bo5CAAmVHq 2020-04-02T23:47:28.801 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:28.856 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 88fad508-815e-46fa-ae41-723473e13722 0 2020-04-02T23:47:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 Processor -- start 2020-04-02T23:47:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 -- start start 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2ddc024f10 0x7f2ddc0a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc05eff0 0x7f2ddc0a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ddc09ef30 0x7f2ddc0802f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0a0530 con 0x7f2ddc09ef30 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc09f6b0 con 0x7f2ddc024f10 2020-04-02T23:47:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.009+0000 7f2de0f7d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc09fc30 con 0x7f2ddc05eff0 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.010+0000 7f2de21df700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ddc09ef30 0x7f2ddc0802f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.010+0000 7f2dd3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc05eff0 0x7f2ddc0a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.010+0000 7f2de21df700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ddc09ef30 0x7f2ddc0802f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44484/0 (socket says 172.21.15.78:44484) 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.010+0000 7f2de21df700 1 -- 172.21.15.78:0/2511746937 learned_addr learned my addr 172.21.15.78:0/2511746937 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 -- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc05eff0 msgr2=0x7f2ddc0a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc05eff0 0x7f2ddc0a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 -- 172.21.15.78:0/2511746937 >> v2:172.21.15.190:3300/0 conn(0x7f2ddc024f10 msgr2=0x7f2ddc0a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> v2:172.21.15.190:3300/0 conn(0x7f2ddc024f10 0x7f2ddc0a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 -- 172.21.15.78:0/2511746937 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc09f970 con 0x7f2ddc09ef30 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.013+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.015+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.026 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.015+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).ready entity=mon.0 client_cookie=9694618d74d20167 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.018+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.018+0000 7f2ddb7fe700 1 -- 172.21.15.78:0/2511746937 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd400a160 con 0x7f2ddc09ef30 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2de21df700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2ddb7fe700 1 -- 172.21.15.78:0/2511746937 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400a2c0 con 0x7f2ddc09ef30 2020-04-02T23:47:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2ddb7fe700 1 -- 172.21.15.78:0/2511746937 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd400a660 con 0x7f2ddc09ef30 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2de0f7d700 1 -- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 msgr2=0x7f2ddc0802f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.019+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f2dd40032b0 tx=0x7f2dd4007dc0).stop 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 -- 172.21.15.78:0/2511746937 shutdown_connections 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ddc09ef30 0x7f2ddc0802f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/2511746937 >> v2:172.21.15.190:3300/0 conn(0x7f2ddc024f10 0x7f2ddc0a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/2511746937 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc05eff0 0x7f2ddc0a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 -- 172.21.15.78:0/2511746937 >> 172.21.15.78:0/2511746937 conn(0x7f2ddc0ac970 msgr2=0x7f2ddc0acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 -- 172.21.15.78:0/2511746937 shutdown_connections 2020-04-02T23:47:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.020+0000 7f2de0f7d700 1 -- 172.21.15.78:0/2511746937 wait complete. 2020-04-02T23:47:29.031 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.021+0000 7f2de0f7d700 1 Processor -- start 2020-04-02T23:47:29.031 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.021+0000 7f2de0f7d700 1 -- start start 2020-04-02T23:47:29.031 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.021+0000 7f2de0f7d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.021+0000 7f2de0f7d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ddc05eff0 0x7f2ddc1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2de0f7d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc132450 con 0x7f2ddc09ef30 2020-04-02T23:47:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2de0f7d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc1326f0 con 0x7f2ddc05eff0 2020-04-02T23:47:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2de0f7d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc132990 con 0x7f2ddc024f10 2020-04-02T23:47:29.032 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59746/0 (socket says 172.21.15.78:59746) 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.022+0000 7f2ddbfff700 1 -- 172.21.15.78:0/448029308 learned_addr learned my addr 172.21.15.78:0/448029308 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.023+0000 7f2dd3fff700 1 --2- 172.21.15.78:0/448029308 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc05eff0 0x7f2ddc1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.026+0000 7f2ddbfff700 1 -- 172.21.15.78:0/448029308 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc05eff0 msgr2=0x7f2ddc1359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.026+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc05eff0 0x7f2ddc1359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.033 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.026+0000 7f2ddbfff700 1 -- 172.21.15.78:0/448029308 >> v1:172.21.15.78:6789/0 conn(0x7f2ddc09ef30 legacy=0x7f2ddc126c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.026+0000 7f2ddbfff700 1 -- 172.21.15.78:0/448029308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc132c30 con 0x7f2ddc024f10 2020-04-02T23:47:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.027+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.028+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.034 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.028+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.036 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.036 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.036 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.036 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc007540 con 0x7f2ddc024f10 2020-04-02T23:47:29.036 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0059e0 con 0x7f2ddc024f10 2020-04-02T23:47:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc005e00 con 0x7f2ddc024f10 2020-04-02T23:47:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc064000 con 0x7f2ddc024f10 2020-04-02T23:47:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.033+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0670d0 con 0x7f2ddc024f10 2020-04-02T23:47:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.034+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc056ec0 con 0x7f2ddc024f10 2020-04-02T23:47:29.141 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.142 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.143 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f2dcc008970 con 0x7f2ddc024f10 2020-04-02T23:47:29.143 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2dd97fa700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.143 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2dcc0614a0 con 0x7f2ddc024f10 2020-04-02T23:47:29.143 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.139+0000 7f2dd3fff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.143 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.140+0000 7f2dd3fff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dc4002f30 tx=0x7f2dc4002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.144 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.140+0000 7f2dd3fff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dc4002f30 tx=0x7f2dc4002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.144 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.140+0000 7f2dd3fff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f2dc4002f30 tx=0x7f2dc4002ed0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.290 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.287+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.290 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.287+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2dcc03c5a0 con 0x7f2ddc024f10 2020-04-02T23:47:29.452 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.450+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "88fad508-815e-46fa-ae41-723473e13722", "id": 0} v 0) v1 -- 0x7f2ddc069a00 con 0x7f2ddc024f10 2020-04-02T23:47:29.676 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.673+0000 7f2ddbfff700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.676 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.673+0000 7f2dd97fa700 1 -- 172.21.15.78:0/448029308 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88fad508-815e-46fa-ae41-723473e13722", "id": 0}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dcc03fbc0 con 0x7f2ddc024f10 2020-04-02T23:47:29.676 INFO:teuthology.orchestra.run.smithi078.stdout:0 2020-04-02T23:47:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.675+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 msgr2=0x7f2dc004f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.675+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f2dc4002f30 tx=0x7f2dc4002ed0).stop 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.675+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 msgr2=0x7f2ddc063ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.675+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f2dcc002f30 tx=0x7f2dcc010990).stop 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 shutdown_connections 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2dc004d4a0 0x7f2dc004f9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/448029308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ddc024f10 0x7f2ddc063ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 --2- 172.21.15.78:0/448029308 >> v2:172.21.15.78:3300/0 conn(0x7f2ddc05eff0 0x7f2ddc1359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 >> 172.21.15.78:0/448029308 conn(0x7f2ddc0ac970 msgr2=0x7f2ddc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:29.680 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 shutdown_connections 2020-04-02T23:47:29.680 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.676+0000 7f2de0f7d700 1 -- 172.21.15.78:0/448029308 wait complete. 2020-04-02T23:47:29.689 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:29.707 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 30c511d9-8d3c-4014-ad39-2eb4dca528cd 1 2020-04-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 Processor -- start 2020-04-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 -- start start 2020-04-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0a7490 0x7fd1ec0a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec0a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec0a7d00 con 0x7fd1ec0a7490 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec0a6140 con 0x7fd1ec0a2b40 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.853+0000 7fd1f2f78700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec0a63e0 con 0x7fd1ec05b750 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.854+0000 7fd1f1515700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.854+0000 7fd1f1d16700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec0a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.854+0000 7fd1f1515700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59756/0 (socket says 172.21.15.78:59756) 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.854+0000 7fd1f1515700 1 -- 172.21.15.78:0/3019629710 learned_addr learned my addr 172.21.15.78:0/3019629710 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.855+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/3019629710 >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0a7490 0x7fd1ec0a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 -- 172.21.15.78:0/3019629710 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 msgr2=0x7fd1ec0a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec0a2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 -- 172.21.15.78:0/3019629710 >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0a7490 msgr2=0x7fd1ec0a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0a7490 0x7fd1ec0a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.872 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 -- 172.21.15.78:0/3019629710 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0a6680 con 0x7fd1ec05b750 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.857+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.859+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.859+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).ready entity=mon.2 client_cookie=bf7dd248bcfcf5b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1f1515700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.873 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1dffff700 1 -- 172.21.15.78:0/3019629710 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e00115c0 con 0x7fd1ec05b750 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1dffff700 1 -- 172.21.15.78:0/3019629710 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0011720 con 0x7fd1ec05b750 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1dffff700 1 -- 172.21.15.78:0/3019629710 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e0011b00 con 0x7fd1ec05b750 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1f2f78700 1 -- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 msgr2=0x7fd1ec0a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.863+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd1e0002f30 tx=0x7fd1e0007a40).stop 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 -- 172.21.15.78:0/3019629710 shutdown_connections 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/3019629710 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec0a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/3019629710 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec0a6b20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/3019629710 >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0a7490 0x7fd1ec0a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 -- 172.21.15.78:0/3019629710 >> 172.21.15.78:0/3019629710 conn(0x7fd1ec0ab4f0 msgr2=0x7fd1ec0ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 -- 172.21.15.78:0/3019629710 shutdown_connections 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.864+0000 7fd1f2f78700 1 -- 172.21.15.78:0/3019629710 wait complete. 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.865+0000 7fd1f2f78700 1 Processor -- start 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.865+0000 7fd1f2f78700 1 -- start start 2020-04-02T23:47:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f2f78700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f2f78700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec064b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f2f78700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec064f70 con 0x7fd1ec0a7490 2020-04-02T23:47:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f2f78700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec135b00 con 0x7fd1ec0a2b40 2020-04-02T23:47:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f2f78700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec065ef0 con 0x7fd1ec05b750 2020-04-02T23:47:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f1515700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.866+0000 7fd1f0d14700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec064b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.867+0000 7fd1f1515700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59760/0 (socket says 172.21.15.78:59760) 2020-04-02T23:47:29.877 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.867+0000 7fd1f1515700 1 -- 172.21.15.78:0/1958125980 learned_addr learned my addr 172.21.15.78:0/1958125980 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f1515700 1 -- 172.21.15.78:0/1958125980 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 msgr2=0x7fd1ec064b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec064b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f1515700 1 -- 172.21.15.78:0/1958125980 >> v1:172.21.15.190:6789/0 conn(0x7fd1ec0a7490 legacy=0x7fd1ec0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f1515700 1 -- 172.21.15.78:0/1958125980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0651b0 con 0x7fd1ec05b750 2020-04-02T23:47:29.878 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/1958125980 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec064b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:47:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.870+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.872+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.872+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e000f910 con 0x7fd1ec05b750 2020-04-02T23:47:29.884 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0011db0 con 0x7fd1ec05b750 2020-04-02T23:47:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e0007360 con 0x7fd1ec05b750 2020-04-02T23:47:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.876+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec0654b0 con 0x7fd1ec05b750 2020-04-02T23:47:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.877+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec062d80 con 0x7fd1ec05b750 2020-04-02T23:47:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.877+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec056ec0 con 0x7fd1ec05b750 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.890+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7fd1e00056c0 con 0x7fd1ec05b750 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1ddffb700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e80088c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e80088c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.891+0000 7fd1f0d14700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e80088c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.892+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:29.892+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1269+0+0 (secure 0 0 0) 0x7fd1e0084900 con 0x7fd1ec05b750 2020-04-02T23:47:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:30.059+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:30.059+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd1e0080ca0 con 0x7fd1ec05b750 2020-04-02T23:47:30.214 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:30.212+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "30c511d9-8d3c-4014-ad39-2eb4dca528cd", "id": 1} v 0) v1 -- 0x7fd1ec0660d0 con 0x7fd1ec05b750 2020-04-02T23:47:30.870 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:30.867+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:30.938 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:30.952 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:30.999 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:31.016 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:38.064 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.062+0000 7fd1f1515700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.065 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.062+0000 7fd1ddffb700 1 -- 172.21.15.78:0/1958125980 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30c511d9-8d3c-4014-ad39-2eb4dca528cd", "id": 1}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1e0059020 con 0x7fd1ec05b750 2020-04-02T23:47:38.065 INFO:teuthology.orchestra.run.smithi078.stdout:1 2020-04-02T23:47:38.072 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 msgr2=0x7fd1cc04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.072 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e80088c0).stop 2020-04-02T23:47:38.072 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 msgr2=0x7fd1ec121bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd1ec067840 tx=0x7fd1e0007a40).stop 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 shutdown_connections 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd1cc04d4b0 0x7fd1cc04f9c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/1958125980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1ec05b750 0x7fd1ec121bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 --2- 172.21.15.78:0/1958125980 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0a2b40 0x7fd1ec064b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 >> 172.21.15.78:0/1958125980 conn(0x7fd1ec0ab4f0 msgr2=0x7fd1ec0a6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.073 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 shutdown_connections 2020-04-02T23:47:38.074 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.064+0000 7fd1f2f78700 1 -- 172.21.15.78:0/1958125980 wait complete. 2020-04-02T23:47:38.076 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:38.090 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new dba96313-2969-4c1c-a94e-dc7d84424926 2 2020-04-02T23:47:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.232+0000 7fc7607f3700 1 Processor -- start 2020-04-02T23:47:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.232+0000 7fc7607f3700 1 -- start start 2020-04-02T23:47:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc7607f3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc7607f3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580a7d00 con 0x7fc7580a7490 2020-04-02T23:47:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc7607f3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580a6140 con 0x7fc75814dc40 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc7607f3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580a63e0 con 0x7fc75805b750 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc75e58f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc7580a7490 0x7fc7580a4690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34378/0 (socket says 172.21.15.78:34378) 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.233+0000 7fc75e58f700 1 -- 172.21.15.78:0/2494199294 learned_addr learned my addr 172.21.15.78:0/2494199294 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.234+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.236+0000 7fc75dd8e700 1 -- 172.21.15.78:0/2494199294 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046230849 0 0) 0x7fc7580a7d00 con 0x7fc7580a7490 2020-04-02T23:47:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.236+0000 7fc75dd8e700 1 -- 172.21.15.78:0/2494199294 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc744003230 con 0x7fc7580a7490 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.236+0000 7fc75ed90700 1 -- 172.21.15.78:0/2494199294 >> v1:172.21.15.190:6789/0 conn(0x7fc75814dc40 legacy=0x7fc758150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.236+0000 7fc75ed90700 1 -- 172.21.15.78:0/2494199294 >> v1:172.21.15.78:6789/0 conn(0x7fc7580a7490 legacy=0x7fc7580a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.236+0000 7fc75ed90700 1 -- 172.21.15.78:0/2494199294 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580a6680 con 0x7fc75805b750 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.237+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7540032b0 tx=0x7fc754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.238+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7540032b0 tx=0x7fc754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.238+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fc7540032b0 tx=0x7fc754008c60).ready entity=mon.2 client_cookie=545a1217f94ce00f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fc7540032b0 tx=0x7fc754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fc7540032b0 tx=0x7fc754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75dd8e700 1 -- 172.21.15.78:0/2494199294 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc754011e60 con 0x7fc75805b750 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75ed90700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fc7540032b0 tx=0x7fc754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75dd8e700 1 -- 172.21.15.78:0/2494199294 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400a160 con 0x7fc75805b750 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc75dd8e700 1 -- 172.21.15.78:0/2494199294 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75400a500 con 0x7fc75805b750 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc7607f3700 1 -- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 msgr2=0x7fc7580a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.242+0000 7fc7607f3700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fc7540032b0 tx=0x7fc754008c60).stop 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.243+0000 7fc7607f3700 1 -- 172.21.15.78:0/2494199294 shutdown_connections 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.243+0000 7fc7607f3700 1 --2- 172.21.15.78:0/2494199294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc75805b750 0x7fc7580a6b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.243+0000 7fc7607f3700 1 -- 172.21.15.78:0/2494199294 >> 172.21.15.78:0/2494199294 conn(0x7fc7580ab4f0 msgr2=0x7fc7580ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.243+0000 7fc7607f3700 1 -- 172.21.15.78:0/2494199294 shutdown_connections 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.243+0000 7fc7607f3700 1 -- 172.21.15.78:0/2494199294 wait complete. 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.244+0000 7fc7607f3700 1 Processor -- start 2020-04-02T23:47:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.244+0000 7fc7607f3700 1 -- start start 2020-04-02T23:47:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc7607f3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc7607f3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758134530 con 0x7fc75805b750 2020-04-02T23:47:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc7607f3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758065e40 con 0x7fc75814dc40 2020-04-02T23:47:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc7607f3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc758066d70 con 0x7fc7580a7490 2020-04-02T23:47:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc75e58f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc75ed90700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc75805b750 0x7fc758133e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34384/0 (socket says 172.21.15.78:34384) 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.245+0000 7fc75ed90700 1 -- 172.21.15.78:0/1873157971 learned_addr learned my addr 172.21.15.78:0/1873157971 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.248+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191560637 0 0) 0x7fc758134530 con 0x7fc75805b750 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.248+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc740003230 con 0x7fc75805b750 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.249+0000 7fc75e58f700 1 -- 172.21.15.78:0/1873157971 >> v1:172.21.15.190:6789/0 conn(0x7fc75814dc40 legacy=0x7fc75813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.249+0000 7fc75e58f700 1 -- 172.21.15.78:0/1873157971 >> v1:172.21.15.78:6789/0 conn(0x7fc75805b750 legacy=0x7fc758133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.249+0000 7fc75e58f700 1 -- 172.21.15.78:0/1873157971 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7581336e0 con 0x7fc7580a7490 2020-04-02T23:47:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.250+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.252+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.252+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc748005cc0 con 0x7fc7580a7490 2020-04-02T23:47:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748005e20 con 0x7fc7580a7490 2020-04-02T23:47:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7480062b0 con 0x7fc7580a7490 2020-04-02T23:47:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc758133980 con 0x7fc7580a7490 2020-04-02T23:47:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.256+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc758063d70 con 0x7fc7580a7490 2020-04-02T23:47:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.257+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758056ec0 con 0x7fc7580a7490 2020-04-02T23:47:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.269+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.271 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.270+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7fc748006520 con 0x7fc7580a7490 2020-04-02T23:47:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.270+0000 7fc74f7fe700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.272 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.270+0000 7fc75ed90700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.270+0000 7fc75ed90700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc754008840 tx=0x7fc758060d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.270+0000 7fc75ed90700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc754008840 tx=0x7fc758060d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.271+0000 7fc75ed90700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc754008840 tx=0x7fc758060d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.438+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.438+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1384+0+0 (secure 0 0 0) 0x7fc748040380 con 0x7fc7580a7490 2020-04-02T23:47:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.438+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.438+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc74803c6c0 con 0x7fc7580a7490 2020-04-02T23:47:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:38.592+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dba96313-2969-4c1c-a94e-dc7d84424926", "id": 2} v 0) v1 -- 0x7fc758067b90 con 0x7fc7580a7490 2020-04-02T23:47:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:39.246+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:42.008+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:42.009+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc748042170 con 0x7fc7580a7490 2020-04-02T23:47:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.181+0000 7fc75e58f700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.182 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.181+0000 7fc74f7fe700 1 -- 172.21.15.78:0/1873157971 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dba96313-2969-4c1c-a94e-dc7d84424926", "id": 2}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc748017d70 con 0x7fc7580a7490 2020-04-02T23:47:49.183 INFO:teuthology.orchestra.run.smithi078.stdout:2 2020-04-02T23:47:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 msgr2=0x7fc74004fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc754008840 tx=0x7fc758060d30).stop 2020-04-02T23:47:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 msgr2=0x7fc75807f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.184 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fc7480010d0 tx=0x7fc748010910).stop 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 shutdown_connections 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc74004d780 0x7fc74004fc90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.182+0000 7fc7607f3700 1 --2- 172.21.15.78:0/1873157971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7580a7490 0x7fc75807f810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.183+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 >> 172.21.15.78:0/1873157971 conn(0x7fc7580ab4f0 msgr2=0x7fc7580a4620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.183+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 shutdown_connections 2020-04-02T23:47:49.185 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.183+0000 7fc7607f3700 1 -- 172.21.15.78:0/1873157971 wait complete. 2020-04-02T23:47:49.195 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:49.209 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new fb2e684a-97f1-49d3-8863-b5efd44ed407 3 2020-04-02T23:47:49.388 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 Processor -- start 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 -- start start 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b40a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b40a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95b40a2b40 0x7f95b40a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.368+0000 7f95b8d52700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40a7d00 con 0x7f95b405b750 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.369+0000 7f95b8d52700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40a6140 con 0x7f95b40a2b40 2020-04-02T23:47:49.389 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.369+0000 7f95b8d52700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40a63e0 con 0x7f95b40a7490 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.375+0000 7f95b2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b40a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.375+0000 7f95b2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b40a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44536/0 (socket says 172.21.15.78:44536) 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.375+0000 7f95b2d9d700 1 -- 172.21.15.78:0/3633805592 learned_addr learned my addr 172.21.15.78:0/3633805592 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.378+0000 7f95b2d9d700 1 -- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 msgr2=0x7f95b40a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.378+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b40a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.378+0000 7f95b2d9d700 1 -- 172.21.15.78:0/3633805592 >> v2:172.21.15.190:3300/0 conn(0x7f95b40a2b40 msgr2=0x7f95b40a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:49.390 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.378+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> v2:172.21.15.190:3300/0 conn(0x7f95b40a2b40 0x7f95b40a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.378+0000 7f95b2d9d700 1 -- 172.21.15.78:0/3633805592 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40a6680 con 0x7f95b405b750 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.379+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95a4002f30 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.380+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95a4002f30 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.380+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f95a4002f30 tx=0x7f95a4007a40).ready entity=mon.0 client_cookie=4906b59a8adfdfaa server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f95a4002f30 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f95a4002f30 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f95a4002f30 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b259c700 1 -- 172.21.15.78:0/3633805592 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a4011720 con 0x7f95b405b750 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b259c700 1 -- 172.21.15.78:0/3633805592 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4011880 con 0x7f95b405b750 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.384+0000 7f95b259c700 1 -- 172.21.15.78:0/3633805592 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a4011c60 con 0x7f95b405b750 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 -- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 msgr2=0x7f95b40a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f95a4002f30 tx=0x7f95a4007a40).stop 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 -- 172.21.15.78:0/3633805592 shutdown_connections 2020-04-02T23:47:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 --2- 172.21.15.78:0/3633805592 >> v2:172.21.15.190:3300/0 conn(0x7f95b40a2b40 0x7f95b40a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b40a6b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 --2- 172.21.15.78:0/3633805592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b40a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 -- 172.21.15.78:0/3633805592 >> 172.21.15.78:0/3633805592 conn(0x7f95b40ab4f0 msgr2=0x7f95b40ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 -- 172.21.15.78:0/3633805592 shutdown_connections 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.385+0000 7f95b8d52700 1 -- 172.21.15.78:0/3633805592 wait complete. 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.386+0000 7f95b8d52700 1 Processor -- start 2020-04-02T23:47:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 -- start start 2020-04-02T23:47:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b4064620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b4132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b4132720 con 0x7f95b40a2b40 2020-04-02T23:47:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4135d20 con 0x7f95b405b750 2020-04-02T23:47:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.387+0000 7f95b8d52700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4064e50 con 0x7f95b40a7490 2020-04-02T23:47:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.388+0000 7f95b2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b4064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.388+0000 7f95abfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f95b40a2b40 0x7f95b41363c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34404/0 (socket says 172.21.15.78:34404) 2020-04-02T23:47:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.388+0000 7f95abfff700 1 -- 172.21.15.78:0/2249678746 learned_addr learned my addr 172.21.15.78:0/2249678746 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.392+0000 7f95b2d9d700 1 -- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 msgr2=0x7f95b4132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.392+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b4132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.392+0000 7f95b2d9d700 1 -- 172.21.15.78:0/2249678746 >> v1:172.21.15.78:6789/0 conn(0x7f95b40a2b40 legacy=0x7f95b41363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.392+0000 7f95b2d9d700 1 -- 172.21.15.78:0/2249678746 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4135f20 con 0x7f95b405b750 2020-04-02T23:47:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.393+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.395+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> v2:172.21.15.78:3300/0 conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.395+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.399+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.399+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a4007150 con 0x7f95b405b750 2020-04-02T23:47:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.399+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b4136ad0 con 0x7f95b405b750 2020-04-02T23:47:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.399+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b409e740 con 0x7f95b405b750 2020-04-02T23:47:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.400+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4064cc0 con 0x7f95b405b750 2020-04-02T23:47:49.402 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.401+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.402 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.401+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.401+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a40072b0 con 0x7f95b405b750 2020-04-02T23:47:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.401+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a40056c0 con 0x7f95b405b750 2020-04-02T23:47:49.553 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.552+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f95a4005820 con 0x7f95b405b750 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95ab7fe700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f95a40619e0 con 0x7f95b405b750 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95abfff700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95abfff700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95b4080e50 tx=0x7f959c002510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.555 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95abfff700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95b4080e50 tx=0x7f959c002510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.556 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.553+0000 7f95abfff700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f95b4080e50 tx=0x7f959c002510).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.593+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.593+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f95a403d160 con 0x7f95b405b750 2020-04-02T23:47:49.748 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.746+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb2e684a-97f1-49d3-8863-b5efd44ed407", "id": 3} v 0) v1 -- 0x7f95b41360b0 con 0x7f95b405b750 2020-04-02T23:47:49.814 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.813+0000 7f95b2d9d700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:49.814 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.813+0000 7f95ab7fe700 1 -- 172.21.15.78:0/2249678746 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb2e684a-97f1-49d3-8863-b5efd44ed407", "id": 3}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95a4040780 con 0x7f95b405b750 2020-04-02T23:47:49.815 INFO:teuthology.orchestra.run.smithi078.stdout:3 2020-04-02T23:47:49.817 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.815+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 msgr2=0x7f959804fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.817 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.815+0000 7f95b8d52700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f95b4080e50 tx=0x7f959c002510).stop 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.815+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 msgr2=0x7f95b4064620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.815+0000 7f95b8d52700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f95b4065ad0 tx=0x7f95a4007a40).stop 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 shutdown_connections 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f959804d530 0x7f959804fa40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f95b40a7490 0x7f95b4132d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 --2- 172.21.15.78:0/2249678746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b405b750 0x7f95b4064620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:49.818 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 >> 172.21.15.78:0/2249678746 conn(0x7f95b40ab4f0 msgr2=0x7f95b40a6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:49.819 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 shutdown_connections 2020-04-02T23:47:49.819 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.816+0000 7f95b8d52700 1 -- 172.21.15.78:0/2249678746 wait complete. 2020-04-02T23:47:49.827 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:49.842 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 3bae49af-72e5-4d0d-b009-ba9f1f1c9419 4 2020-04-02T23:47:49.998 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.984+0000 7fe7083b1700 1 Processor -- start 2020-04-02T23:47:49.998 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.984+0000 7fe7083b1700 1 -- start start 2020-04-02T23:47:49.998 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe7083b1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:49.998 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe7083b1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe7000a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe7083b1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000a7d00 con 0x7fe7000a2b40 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe7083b1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000a6140 con 0x7fe7000a7490 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe7083b1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000a63e0 con 0x7fe70005b750 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.985+0000 7fe70694e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.986+0000 7fe70614d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe7000a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.986+0000 7fe70694e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59806/0 (socket says 172.21.15.78:59806) 2020-04-02T23:47:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.986+0000 7fe70694e700 1 -- 172.21.15.78:0/3697088497 learned_addr learned my addr 172.21.15.78:0/3697088497 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.988+0000 7fe70694e700 1 -- 172.21.15.78:0/3697088497 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 msgr2=0x7fe7000a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.988+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe7000a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.989+0000 7fe70694e700 1 -- 172.21.15.78:0/3697088497 >> v1:172.21.15.190:6789/0 conn(0x7fe7000a2b40 legacy=0x7fe7000a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.989+0000 7fe70694e700 1 -- 172.21.15.78:0/3697088497 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000a6680 con 0x7fe70005b750 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.989+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.000 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.990+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.990+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).ready entity=mon.2 client_cookie=a05dd52e5f38dafb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.993+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.993+0000 7fe70594c700 1 -- 172.21.15.78:0/3697088497 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc011670 con 0x7fe70005b750 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe70694e700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe70594c700 1 -- 172.21.15.78:0/3697088497 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc0117d0 con 0x7fe70005b750 2020-04-02T23:47:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe70594c700 1 -- 172.21.15.78:0/3697088497 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc011bf0 con 0x7fe70005b750 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 -- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 msgr2=0x7fe7000a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).stop 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 -- 172.21.15.78:0/3697088497 shutdown_connections 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 --2- 172.21.15.78:0/3697088497 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe7000a6b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 --2- 172.21.15.78:0/3697088497 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe7000a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 -- 172.21.15.78:0/3697088497 >> 172.21.15.78:0/3697088497 conn(0x7fe7000ab4f0 msgr2=0x7fe7000ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 -- 172.21.15.78:0/3697088497 shutdown_connections 2020-04-02T23:47:50.002 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.995+0000 7fe7083b1700 1 -- 172.21.15.78:0/3697088497 wait complete. 2020-04-02T23:47:50.003 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 Processor -- start 2020-04-02T23:47:50.003 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 -- start start 2020-04-02T23:47:50.004 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.004 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe700136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.004 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7001371c0 con 0x7fe7000a2b40 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe700133950 con 0x7fe7000a7490 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.997+0000 7fe7083b1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe700133bf0 con 0x7fe70005b750 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.998+0000 7fe70694e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.998+0000 7fe70694e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59810/0 (socket says 172.21.15.78:59810) 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.998+0000 7fe70714f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe700136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:49.998+0000 7fe70694e700 1 -- 172.21.15.78:0/1486960999 learned_addr learned my addr 172.21.15.78:0/1486960999 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:50.005 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.001+0000 7fe70694e700 1 -- 172.21.15.78:0/1486960999 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 msgr2=0x7fe700136d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.006 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.001+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe700136d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.006 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.001+0000 7fe70694e700 1 -- 172.21.15.78:0/1486960999 >> v1:172.21.15.190:6789/0 conn(0x7fe7000a2b40 legacy=0x7fe700064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.006 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.001+0000 7fe70694e700 1 -- 172.21.15.78:0/1486960999 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700133e90 con 0x7fe70005b750 2020-04-02T23:47:50.006 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.002+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.007 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.004+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.007 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.004+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:50.009 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.009 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.010 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.010 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc011e70 con 0x7fe70005b750 2020-04-02T23:47:50.010 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc007150 con 0x7fe70005b750 2020-04-02T23:47:50.011 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe700065500 con 0x7fe70005b750 2020-04-02T23:47:50.012 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6fc007530 con 0x7fe70005b750 2020-04-02T23:47:50.012 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.008+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70009ee40 con 0x7fe70005b750 2020-04-02T23:47:50.013 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.009+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe700056ec0 con 0x7fe70005b750 2020-04-02T23:47:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.022+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.022+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe6fc0056c0 con 0x7fe70005b750 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.022+0000 7fe6f77fe700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.023+0000 7fe70614d700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.023+0000 7fe70614d700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7000649e0 tx=0x7fe6f0008760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.023+0000 7fe70614d700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7000649e0 tx=0x7fe6f0008760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.023+0000 7fe70614d700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fe7000649e0 tx=0x7fe6f0008760).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.193+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.193+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1614+0+0 (secure 0 0 0) 0x7fe6fc084b30 con 0x7fe70005b750 2020-04-02T23:47:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.193+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.193+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe6fc080ed0 con 0x7fe70005b750 2020-04-02T23:47:50.370 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.368+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3bae49af-72e5-4d0d-b009-ba9f1f1c9419", "id": 4} v 0) v1 -- 0x7fe700069c00 con 0x7fe70005b750 2020-04-02T23:47:50.478 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.477+0000 7fe70694e700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.478 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.477+0000 7fe6f77fe700 1 -- 172.21.15.78:0/1486960999 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bae49af-72e5-4d0d-b009-ba9f1f1c9419", "id": 4}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6fc0844f0 con 0x7fe70005b750 2020-04-02T23:47:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:4 2020-04-02T23:47:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 msgr2=0x7fe6e804f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fe7000649e0 tx=0x7fe6f0008760).stop 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 msgr2=0x7fe700134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe6fc002f30 tx=0x7fe6fc007a40).stop 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 shutdown_connections 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe6e804d430 0x7fe6e804f940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 --2- 172.21.15.78:0/1486960999 >> v2:172.21.15.190:3300/0 conn(0x7fe7000a7490 0x7fe700136d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 --2- 172.21.15.78:0/1486960999 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe70005b750 0x7fe700134330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 >> 172.21.15.78:0/1486960999 conn(0x7fe7000ab4f0 msgr2=0x7fe700129d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 shutdown_connections 2020-04-02T23:47:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.479+0000 7fe7083b1700 1 -- 172.21.15.78:0/1486960999 wait complete. 2020-04-02T23:47:50.491 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:50.505 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 174e03aa-ba1e-4823-9c41-b07e17c28177 5 2020-04-02T23:47:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.648+0000 7fd679b54700 1 Processor -- start 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.648+0000 7fd679b54700 1 -- start start 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd679b54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd679b54700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6740a7d00 con 0x7fd67414dc40 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd679b54700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6740a6140 con 0x7fd6740a7490 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd679b54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740a63e0 con 0x7fd67405b750 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd6788f2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd67414dc40 0x7fd674150060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34424/0 (socket says 172.21.15.78:34424) 2020-04-02T23:47:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd6788f2700 1 -- 172.21.15.78:0/2228044628 learned_addr learned my addr 172.21.15.78:0/2228044628 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.649+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.652+0000 7fd6737fe700 1 -- 172.21.15.78:0/2228044628 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927664274 0 0) 0x7fd6740a7d00 con 0x7fd67414dc40 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.652+0000 7fd6737fe700 1 -- 172.21.15.78:0/2228044628 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd660003230 con 0x7fd67414dc40 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.652+0000 7fd673fff700 1 -- 172.21.15.78:0/2228044628 >> v1:172.21.15.190:6789/0 conn(0x7fd6740a7490 legacy=0x7fd6740a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.652+0000 7fd673fff700 1 -- 172.21.15.78:0/2228044628 >> v1:172.21.15.78:6789/0 conn(0x7fd67414dc40 legacy=0x7fd674150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.652+0000 7fd673fff700 1 -- 172.21.15.78:0/2228044628 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740a6680 con 0x7fd67405b750 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.653+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd664002f30 tx=0x7fd6640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.654+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd664002f30 tx=0x7fd6640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.654+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fd664002f30 tx=0x7fd6640088e0).ready entity=mon.2 client_cookie=2c85d445da4fdf34 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.656+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fd664002f30 tx=0x7fd6640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.656+0000 7fd6737fe700 1 -- 172.21.15.78:0/2228044628 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd664008e40 con 0x7fd67405b750 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.657+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fd664002f30 tx=0x7fd6640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.657+0000 7fd673fff700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fd664002f30 tx=0x7fd6640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.657+0000 7fd6737fe700 1 -- 172.21.15.78:0/2228044628 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640115f0 con 0x7fd67405b750 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.657+0000 7fd6737fe700 1 -- 172.21.15.78:0/2228044628 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd664011990 con 0x7fd67405b750 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 -- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 msgr2=0x7fd6740a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fd664002f30 tx=0x7fd6640088e0).stop 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 -- 172.21.15.78:0/2228044628 shutdown_connections 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 --2- 172.21.15.78:0/2228044628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd67405b750 0x7fd6740a6b20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.664 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 -- 172.21.15.78:0/2228044628 >> 172.21.15.78:0/2228044628 conn(0x7fd6740ab4f0 msgr2=0x7fd6740ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:50.665 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 -- 172.21.15.78:0/2228044628 shutdown_connections 2020-04-02T23:47:50.665 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.658+0000 7fd679b54700 1 -- 172.21.15.78:0/2228044628 wait complete. 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.659+0000 7fd679b54700 1 Processor -- start 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.659+0000 7fd679b54700 1 -- start start 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd679b54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd679b54700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd67414dc40 0x7fd67412a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd679b54700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd674066ff0 con 0x7fd67405b750 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd679b54700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd674067290 con 0x7fd67414dc40 2020-04-02T23:47:50.667 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd679b54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd674067530 con 0x7fd6740a7490 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd673fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd67405b750 0x7fd674136e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34428/0 (socket says 172.21.15.78:34428) 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd673fff700 1 -- 172.21.15.78:0/915640731 learned_addr learned my addr 172.21.15.78:0/915640731 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.660+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.661+0000 7fd6788f2700 1 --2- 172.21.15.78:0/915640731 >> v2:172.21.15.190:3300/0 conn(0x7fd67414dc40 0x7fd67412a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.663+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193611514 0 0) 0x7fd674066ff0 con 0x7fd67405b750 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.663+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd658003230 con 0x7fd67405b750 2020-04-02T23:47:50.668 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.664+0000 7fd66bfff700 1 -- 172.21.15.78:0/915640731 >> v2:172.21.15.190:3300/0 conn(0x7fd67414dc40 msgr2=0x7fd67412a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.669 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.664+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> v2:172.21.15.190:3300/0 conn(0x7fd67414dc40 0x7fd67412a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:50.669 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.664+0000 7fd66bfff700 1 -- 172.21.15.78:0/915640731 >> v1:172.21.15.78:6789/0 conn(0x7fd67405b750 legacy=0x7fd674136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:50.669 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.664+0000 7fd66bfff700 1 -- 172.21.15.78:0/915640731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740677d0 con 0x7fd6740a7490 2020-04-02T23:47:50.669 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.665+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.670 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.666+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.670 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.666+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:50.671 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.669+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.672 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.669+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd65c00cb10 con 0x7fd6740a7490 2020-04-02T23:47:50.672 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.669+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd674137510 con 0x7fd6740a7490 2020-04-02T23:47:50.673 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.669+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6740a2e50 con 0x7fd6740a7490 2020-04-02T23:47:50.673 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.670+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd674067b90 con 0x7fd6740a7490 2020-04-02T23:47:50.839 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.837+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.839 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.837+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.839 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.837+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c011e90 con 0x7fd6740a7490 2020-04-02T23:47:50.839 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.837+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd65c00cea0 con 0x7fd6740a7490 2020-04-02T23:47:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.858+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.858+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.858+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd65c0064e0 con 0x7fd6740a7490 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.858+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd6717fa700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1729+0+0 (secure 0 0 0) 0x7fd65c060980 con 0x7fd6740a7490 2020-04-02T23:47:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd65c060d10 con 0x7fd6740a7490 2020-04-02T23:47:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd673fff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd673fff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd664007ed0 tx=0x7fd674060d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd673fff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd664007ed0 tx=0x7fd674060d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:50.859+0000 7fd673fff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fd664007ed0 tx=0x7fd674060d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.012 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.011+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "174e03aa-ba1e-4823-9c41-b07e17c28177", "id": 5} v 0) v1 -- 0x7fd674056ec0 con 0x7fd6740a7490 2020-04-02T23:47:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.088+0000 7fd66bfff700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.088+0000 7fd6717fa700 1 -- 172.21.15.78:0/915640731 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "174e03aa-ba1e-4823-9c41-b07e17c28177", "id": 5}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd65c03bfe0 con 0x7fd6740a7490 2020-04-02T23:47:51.090 INFO:teuthology.orchestra.run.smithi078.stdout:5 2020-04-02T23:47:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 msgr2=0x7fd65804fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fd664007ed0 tx=0x7fd674060d30).stop 2020-04-02T23:47:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 msgr2=0x7fd674122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fd6740a62d0 tx=0x7fd65c0108e0).stop 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 shutdown_connections 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd65804d960 0x7fd65804fe70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 --2- 172.21.15.78:0/915640731 >> v2:172.21.15.190:3300/0 conn(0x7fd67414dc40 0x7fd67412a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 --2- 172.21.15.78:0/915640731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6740a7490 0x7fd674122d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 >> 172.21.15.78:0/915640731 conn(0x7fd6740ab4f0 msgr2=0x7fd67406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 shutdown_connections 2020-04-02T23:47:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.090+0000 7fd679b54700 1 -- 172.21.15.78:0/915640731 wait complete. 2020-04-02T23:47:51.102 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:51.116 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 0dab7226-754e-4317-b2db-fa6a69451475 6 2020-04-02T23:47:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.258+0000 7fc735d0a700 1 Processor -- start 2020-04-02T23:47:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.258+0000 7fc735d0a700 1 -- start start 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc735d0a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc73005b750 0x7fc7300a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc735d0a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300a7d00 con 0x7fc73014dc40 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc735d0a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300a6140 con 0x7fc7300a7490 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc735d0a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300a63e0 con 0x7fc73005b750 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc734aa8700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc73014dc40 0x7fc730150060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34436/0 (socket says 172.21.15.78:34436) 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.259+0000 7fc734aa8700 1 -- 172.21.15.78:0/2476890076 learned_addr learned my addr 172.21.15.78:0/2476890076 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.260+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> v2:172.21.15.190:3300/0 conn(0x7fc73005b750 0x7fc7300a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.262+0000 7fc72f7fe700 1 -- 172.21.15.78:0/2476890076 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066417109 0 0) 0x7fc7300a7d00 con 0x7fc73014dc40 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.262+0000 7fc72f7fe700 1 -- 172.21.15.78:0/2476890076 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71c003230 con 0x7fc73014dc40 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.263+0000 7fc72ffff700 1 -- 172.21.15.78:0/2476890076 >> v1:172.21.15.190:6789/0 conn(0x7fc7300a7490 legacy=0x7fc7300a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.264+0000 7fc72ffff700 1 -- 172.21.15.78:0/2476890076 >> v1:172.21.15.78:6789/0 conn(0x7fc73014dc40 legacy=0x7fc730150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.264+0000 7fc72ffff700 1 -- 172.21.15.78:0/2476890076 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300a6680 con 0x7fc73005b750 2020-04-02T23:47:51.279 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.264+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> v2:172.21.15.190:3300/0 conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc720002f30 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.268+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> v2:172.21.15.190:3300/0 conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc720002f30 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.268+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc720002f30 tx=0x7fc720007a40).ready entity=mon.1 client_cookie=25c5a49f0e5f9d1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc720002f30 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc720002f30 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72ffff700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fc720002f30 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72f7fe700 1 -- 172.21.15.78:0/2476890076 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7200113c0 con 0x7fc73005b750 2020-04-02T23:47:51.280 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72f7fe700 1 -- 172.21.15.78:0/2476890076 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc720011520 con 0x7fc73005b750 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc72f7fe700 1 -- 172.21.15.78:0/2476890076 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7200118c0 con 0x7fc73005b750 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc735d0a700 1 -- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 msgr2=0x7fc7300a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.274+0000 7fc735d0a700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fc720002f30 tx=0x7fc720007a40).stop 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.275+0000 7fc735d0a700 1 -- 172.21.15.78:0/2476890076 shutdown_connections 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.275+0000 7fc735d0a700 1 --2- 172.21.15.78:0/2476890076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc73005b750 0x7fc7300a6b20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.275+0000 7fc735d0a700 1 -- 172.21.15.78:0/2476890076 >> 172.21.15.78:0/2476890076 conn(0x7fc7300ab4f0 msgr2=0x7fc7300ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.275+0000 7fc735d0a700 1 -- 172.21.15.78:0/2476890076 shutdown_connections 2020-04-02T23:47:51.281 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.275+0000 7fc735d0a700 1 -- 172.21.15.78:0/2476890076 wait complete. 2020-04-02T23:47:51.282 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 Processor -- start 2020-04-02T23:47:51.282 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 -- start start 2020-04-02T23:47:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7300a7490 0x7fc7301325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300621f0 con 0x7fc73014dc40 2020-04-02T23:47:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300645b0 con 0x7fc73005b750 2020-04-02T23:47:51.283 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.276+0000 7fc735d0a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc730064850 con 0x7fc7300a7490 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.277+0000 7fc72ffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc73005b750 0x7fc730061ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.78:59304/0 (socket says 172.21.15.78:59304) 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.277+0000 7fc72ffff700 1 -- 172.21.15.78:0/1349528297 learned_addr learned my addr 172.21.15.78:0/1349528297 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.277+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> v2:172.21.15.78:3300/0 conn(0x7fc7300a7490 0x7fc7301325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.280+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007730561 0 0) 0x7fc7300645b0 con 0x7fc73005b750 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.280+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc714003230 con 0x7fc73005b750 2020-04-02T23:47:51.284 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.281+0000 7fc727fff700 1 -- 172.21.15.78:0/1349528297 >> v1:172.21.15.190:6789/0 conn(0x7fc73005b750 legacy=0x7fc730061ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.285 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.281+0000 7fc727fff700 1 -- 172.21.15.78:0/1349528297 >> v1:172.21.15.78:6789/0 conn(0x7fc73014dc40 legacy=0x7fc73007f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.285 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.281+0000 7fc727fff700 1 -- 172.21.15.78:0/1349528297 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300641c0 con 0x7fc7300a7490 2020-04-02T23:47:51.285 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.281+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> v2:172.21.15.78:3300/0 conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.286 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.284+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> v2:172.21.15.78:3300/0 conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.286 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.284+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.290 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.289+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.291 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.289+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc71800cc00 con 0x7fc7300a7490 2020-04-02T23:47:51.291 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.289+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7300a9f00 con 0x7fc7300a7490 2020-04-02T23:47:51.291 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.289+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7300aa1b0 con 0x7fc7300a7490 2020-04-02T23:47:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.290+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc730064410 con 0x7fc7300a7490 2020-04-02T23:47:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.290+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.290+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.290+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71800cda0 con 0x7fc7300a7490 2020-04-02T23:47:51.292 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.290+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7180066d0 con 0x7fc7300a7490 2020-04-02T23:47:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.304+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.305+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc718006830 con 0x7fc7300a7490 2020-04-02T23:47:51.306 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.305+0000 7fc72d7fa700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:51.307 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.305+0000 7fc72ffff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.307 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.306+0000 7fc72ffff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc720007ed0 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.307 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.306+0000 7fc72ffff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc720007ed0 tx=0x7fc720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.308 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.306+0000 7fc72ffff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fc720007ed0 tx=0x7fc720007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.308+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.309 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.308+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1844+0+0 (secure 0 0 0) 0x7fc71803fd60 con 0x7fc7300a7490 2020-04-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.494+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.494+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc71803c100 con 0x7fc7300a7490 2020-04-02T23:47:51.671 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.670+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0dab7226-754e-4317-b2db-fa6a69451475", "id": 6} v 0) v1 -- 0x7fc730132320 con 0x7fc7300a7490 2020-04-02T23:47:51.740 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.739+0000 7fc727fff700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.740 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.739+0000 7fc72d7fa700 1 -- 172.21.15.78:0/1349528297 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0dab7226-754e-4317-b2db-fa6a69451475", "id": 6}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc71803f720 con 0x7fc7300a7490 2020-04-02T23:47:51.741 INFO:teuthology.orchestra.run.smithi078.stdout:6 2020-04-02T23:47:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.740+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 msgr2=0x7fc71404fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.740+0000 7fc735d0a700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fc720007ed0 tx=0x7fc720007a40).stop 2020-04-02T23:47:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.740+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 msgr2=0x7fc7301325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.740+0000 7fc735d0a700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fc730060d90 tx=0x7fc7180108e0).stop 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 shutdown_connections 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc71404d8a0 0x7fc71404fdb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 --2- 172.21.15.78:0/1349528297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7300a7490 0x7fc7301325f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 >> 172.21.15.78:0/1349528297 conn(0x7fc7300ab4f0 msgr2=0x7fc7300a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 shutdown_connections 2020-04-02T23:47:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.741+0000 7fc735d0a700 1 -- 172.21.15.78:0/1349528297 wait complete. 2020-04-02T23:47:51.755 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:51.769 INFO:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new df871ce6-4780-4a5f-9fe2-d513065e7595 7 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.911+0000 7fa3a81af700 1 Processor -- start 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.911+0000 7fa3a81af700 1 -- start start 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a81af700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a81af700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3a00a7490 0x7fa3a00a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a81af700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00a7d00 con 0x7fa3a00a2b40 2020-04-02T23:47:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a81af700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00a6140 con 0x7fa3a00a7490 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a81af700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00a63e0 con 0x7fa3a005b750 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a674c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.912+0000 7fa3a5f4b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3a00a7490 0x7fa3a00a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.913+0000 7fa3a674c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:59842/0 (socket says 172.21.15.78:59842) 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.913+0000 7fa3a674c700 1 -- 172.21.15.78:0/2989560958 learned_addr learned my addr 172.21.15.78:0/2989560958 (peer_addr_for_me v2:172.21.15.78:0/0) 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.915+0000 7fa3a674c700 1 -- 172.21.15.78:0/2989560958 >> v2:172.21.15.78:3300/0 conn(0x7fa3a00a7490 msgr2=0x7fa3a00a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.915+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> v2:172.21.15.78:3300/0 conn(0x7fa3a00a7490 0x7fa3a00a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.915+0000 7fa3a674c700 1 -- 172.21.15.78:0/2989560958 >> v1:172.21.15.78:6789/0 conn(0x7fa3a00a2b40 legacy=0x7fa3a00a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.915+0000 7fa3a674c700 1 -- 172.21.15.78:0/2989560958 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00a6680 con 0x7fa3a005b750 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.916+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa39c002f30 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.917+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa39c002f30 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.917+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fa39c002f30 tx=0x7fa39c007a40).ready entity=mon.2 client_cookie=12b6615c3c8acf16 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fa39c002f30 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fa39c002f30 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.927 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a674c700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fa39c002f30 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a574a700 1 -- 172.21.15.78:0/2989560958 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa39c011670 con 0x7fa3a005b750 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a574a700 1 -- 172.21.15.78:0/2989560958 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0117d0 con 0x7fa3a005b750 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a574a700 1 -- 172.21.15.78:0/2989560958 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa39c011bf0 con 0x7fa3a005b750 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 -- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 msgr2=0x7fa3a00a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fa39c002f30 tx=0x7fa39c007a40).stop 2020-04-02T23:47:51.928 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 -- 172.21.15.78:0/2989560958 shutdown_connections 2020-04-02T23:47:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 --2- 172.21.15.78:0/2989560958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a005b750 0x7fa3a00a6b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 --2- 172.21.15.78:0/2989560958 >> v2:172.21.15.78:3300/0 conn(0x7fa3a00a7490 0x7fa3a00a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 -- 172.21.15.78:0/2989560958 >> 172.21.15.78:0/2989560958 conn(0x7fa3a00ab4f0 msgr2=0x7fa3a00ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.922+0000 7fa3a81af700 1 -- 172.21.15.78:0/2989560958 shutdown_connections 2020-04-02T23:47:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.923+0000 7fa3a81af700 1 -- 172.21.15.78:0/2989560958 wait complete. 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 Processor -- start 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 -- start start 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a01396d0 con 0x7fa3a005b750 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a0139970 con 0x7fa3a00a2b40 2020-04-02T23:47:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.924+0000 7fa3a81af700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0139c10 con 0x7fa3a00a7490 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.925+0000 7fa3a6f4d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.925+0000 7fa3a674c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3a005b750 0x7fa3a0135ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34454/0 (socket says 172.21.15.78:34454) 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.925+0000 7fa3a674c700 1 -- 172.21.15.78:0/1244732324 learned_addr learned my addr 172.21.15.78:0/1244732324 (peer_addr_for_me v1:172.21.15.78:0/0) 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.927+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577621668 0 0) 0x7fa3a01396d0 con 0x7fa3a005b750 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.927+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388003230 con 0x7fa3a005b750 2020-04-02T23:47:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.928+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178895122 0 0) 0x7fa3a0139970 con 0x7fa3a00a2b40 2020-04-02T23:47:51.935 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.928+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a01396d0 con 0x7fa3a00a2b40 2020-04-02T23:47:51.935 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.929+0000 7fa3a6f4d700 1 -- 172.21.15.78:0/1244732324 >> v1:172.21.15.190:6789/0 conn(0x7fa3a00a2b40 legacy=0x7fa3a007f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.935 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.929+0000 7fa3a6f4d700 1 -- 172.21.15.78:0/1244732324 >> v1:172.21.15.78:6789/0 conn(0x7fa3a005b750 legacy=0x7fa3a0135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:51.935 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.929+0000 7fa3a6f4d700 1 -- 172.21.15.78:0/1244732324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a01361e0 con 0x7fa3a00a7490 2020-04-02T23:47:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.930+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.931+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.931+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa398002220 con 0x7fa3a00a7490 2020-04-02T23:47:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398002380 con 0x7fa3a00a7490 2020-04-02T23:47:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3980027a0 con 0x7fa3a00a7490 2020-04-02T23:47:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0136430 con 0x7fa3a00a7490 2020-04-02T23:47:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.935+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a009ee40 con 0x7fa3a00a7490 2020-04-02T23:47:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:51.937+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0139e10 con 0x7fa3a00a7490 2020-04-02T23:47:52.126 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.124+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.127 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.127 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa398002a10 con 0x7fa3a00a7490 2020-04-02T23:47:52.127 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa396ffd700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1959+0+0 (secure 0 0 0) 0x7fa398013060 con 0x7fa3a00a7490 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa398061580 con 0x7fa3a00a7490 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.125+0000 7fa3a674c700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.126+0000 7fa3a674c700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3a00a8f60 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.128 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.126+0000 7fa3a674c700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3a00a8f60 tx=0x7fa39c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.129 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.126+0000 7fa3a674c700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fa3a00a8f60 tx=0x7fa39c007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:52.286 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.285+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df871ce6-4780-4a5f-9fe2-d513065e7595", "id": 7} v 0) v1 -- 0x7fa3a0056ec0 con 0x7fa3a00a7490 2020-04-02T23:47:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.380+0000 7fa3a6f4d700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.380+0000 7fa396ffd700 1 -- 172.21.15.78:0/1244732324 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df871ce6-4780-4a5f-9fe2-d513065e7595", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa39803cae0 con 0x7fa3a00a7490 2020-04-02T23:47:52.382 INFO:teuthology.orchestra.run.smithi078.stdout:7 2020-04-02T23:47:52.383 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.382+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 msgr2=0x7fa38804ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:52.384 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.382+0000 7fa3a81af700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fa3a00a8f60 tx=0x7fa39c007a40).stop 2020-04-02T23:47:52.384 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.382+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 msgr2=0x7fa3a01279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:52.384 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.382+0000 7fa3a81af700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fa3a00a45a0 tx=0x7fa398010ba0).stop 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 shutdown_connections 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa38804da60 0x7fa38804ff70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 --2- 172.21.15.78:0/1244732324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3a00a7490 0x7fa3a01279c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 >> 172.21.15.78:0/1244732324 conn(0x7fa3a00ab4f0 msgr2=0x7fa3a0129d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 shutdown_connections 2020-04-02T23:47:52.385 INFO:teuthology.orchestra.run.smithi078.stderr:2020-04-02T23:47:52.383+0000 7fa3a81af700 1 -- 172.21.15.78:0/1244732324 wait complete. 2020-04-02T23:47:52.396 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.396 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-02T23:47:52.396 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:52.412 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2020-04-02T23:47:52.454 INFO:tasks.ceph.osd.0:Started 2020-04-02T23:47:52.454 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.454 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-02T23:47:52.455 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:52.469 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2020-04-02T23:47:52.515 INFO:tasks.ceph.osd.1:Started 2020-04-02T23:47:52.516 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.516 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-02T23:47:52.516 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:52.532 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2020-04-02T23:47:52.575 INFO:tasks.ceph.osd.2:Started 2020-04-02T23:47:52.575 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.575 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-02T23:47:52.575 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:52.591 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2020-04-02T23:47:52.634 INFO:tasks.ceph.osd.3:Started 2020-04-02T23:47:52.634 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.635 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-02T23:47:52.635 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:52.649 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2020-04-02T23:47:52.691 INFO:tasks.ceph.osd.4:Started 2020-04-02T23:47:52.692 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.692 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-02T23:47:52.692 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:52.705 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2020-04-02T23:47:52.747 INFO:tasks.ceph.osd.5:Started 2020-04-02T23:47:52.747 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.748 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-02T23:47:52.748 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:52.761 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2020-04-02T23:47:52.804 INFO:tasks.ceph.osd.6:Started 2020-04-02T23:47:52.804 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:47:52.805 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-02T23:47:52.805 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:47:52.820 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2020-04-02T23:47:52.862 INFO:tasks.ceph.osd.7:Started 2020-04-02T23:47:52.863 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-02T23:47:53.670 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:47:53.688 INFO:teuthology.orchestra.run.smithi190:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.889+0000 7fae3c19d700 1 Processor -- start 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.889+0000 7fae3c19d700 1 -- start start 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.890+0000 7fae3c19d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fae34149930 0x7fae34149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.890+0000 7fae3c19d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.890+0000 7fae3c19d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae34149500 con 0x7fae34080b60 2020-04-02T23:47:53.910 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.890+0000 7fae3c19d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340a6670 con 0x7fae34149930 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.890+0000 7fae3c19d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340a28f0 con 0x7fae340802f0 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.891+0000 7fae3a73a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fae34149930 0x7fae34149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.891+0000 7fae39f39700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.892+0000 7fae39f39700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:45920/0 (socket says 172.21.15.190:45920) 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.892+0000 7fae39f39700 1 -- 172.21.15.190:0/3304475470 learned_addr learned my addr 172.21.15.190:0/3304475470 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.896+0000 7fae39f39700 1 -- 172.21.15.190:0/3304475470 >> v2:172.21.15.190:3300/0 conn(0x7fae34149930 msgr2=0x7fae34149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:53.911 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.896+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> v2:172.21.15.190:3300/0 conn(0x7fae34149930 0x7fae34149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.896+0000 7fae39f39700 1 -- 172.21.15.190:0/3304475470 >> v1:172.21.15.190:6789/0 conn(0x7fae34080b60 legacy=0x7fae340a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.896+0000 7fae39f39700 1 -- 172.21.15.190:0/3304475470 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340a2b90 con 0x7fae340802f0 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.897+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.899+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.899+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).ready entity=mon.2 client_cookie=a251773b1b925bbe server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.903+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.912 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.903+0000 7fae39738700 1 -- 172.21.15.190:0/3304475470 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae24011670 con 0x7fae340802f0 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae39f39700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae39738700 1 -- 172.21.15.190:0/3304475470 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240117d0 con 0x7fae340802f0 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae39738700 1 -- 172.21.15.190:0/3304475470 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae24011bf0 con 0x7fae340802f0 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae3c19d700 1 -- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 msgr2=0x7fae34080700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.906+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).stop 2020-04-02T23:47:53.913 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 -- 172.21.15.190:0/3304475470 shutdown_connections 2020-04-02T23:47:53.914 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3304475470 >> v2:172.21.15.190:3300/0 conn(0x7fae34149930 0x7fae34149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:53.914 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3304475470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae340802f0 0x7fae34080700 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:53.914 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 -- 172.21.15.190:0/3304475470 >> 172.21.15.190:0/3304475470 conn(0x7fae3409e4b0 msgr2=0x7fae3409e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:53.914 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 -- 172.21.15.190:0/3304475470 shutdown_connections 2020-04-02T23:47:53.914 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.907+0000 7fae3c19d700 1 -- 172.21.15.190:0/3304475470 wait complete. 2020-04-02T23:47:53.915 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.908+0000 7fae3c19d700 1 Processor -- start 2020-04-02T23:47:53.915 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.909+0000 7fae3c19d700 1 -- start start 2020-04-02T23:47:53.915 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.909+0000 7fae3c19d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fae340802f0 0x7fae3412f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.909+0000 7fae3c19d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 0x7fae34061d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3c19d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae34149930 0x7fae3409fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3c19d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae34125d10 con 0x7fae34080b60 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3c19d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3412fc80 con 0x7fae340802f0 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3c19d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3412ff20 con 0x7fae34149930 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3a73a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fae340802f0 0x7fae3412f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.916 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae39f39700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 0x7fae34061d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.917 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.910+0000 7fae3af3b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae34149930 0x7fae3409fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.917 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.911+0000 7fae39f39700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 0x7fae34061d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:50944/0 (socket says 172.21.15.190:50944) 2020-04-02T23:47:53.917 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.911+0000 7fae39f39700 1 -- 172.21.15.190:0/3519469362 learned_addr learned my addr 172.21.15.190:0/3519469362 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:47:53.918 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.916+0000 7fae3a73a700 1 -- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae34149930 msgr2=0x7fae3409fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:53.918 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.916+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae34149930 0x7fae3409fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:53.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.916+0000 7fae3a73a700 1 -- 172.21.15.190:0/3519469362 >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 msgr2=0x7fae34061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:53.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.916+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 0x7fae34061d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:53.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.916+0000 7fae3a73a700 1 -- 172.21.15.190:0/3519469362 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3412f8f0 con 0x7fae340802f0 2020-04-02T23:47:53.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.918+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> v2:172.21.15.190:3300/0 conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.920+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> v2:172.21.15.190:3300/0 conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.920+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:53.929 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.926+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.929 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.929 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.929 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30007530 con 0x7fae340802f0 2020-04-02T23:47:53.929 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae300056c0 con 0x7fae340802f0 2020-04-02T23:47:53.930 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30005ae0 con 0x7fae340802f0 2020-04-02T23:47:53.930 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340a1a00 con 0x7fae340802f0 2020-04-02T23:47:53.930 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.927+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae340a1030 con 0x7fae340802f0 2020-04-02T23:47:53.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.931+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3412fa80 con 0x7fae340802f0 2020-04-02T23:47:53.959 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.957+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.960 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.958+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fae30005d50 con 0x7fae340802f0 2020-04-02T23:47:53.960 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.958+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.961 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.958+0000 7fae2affd700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:53.961 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.958+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fae3000d0c0 con 0x7fae340802f0 2020-04-02T23:47:53.961 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.959+0000 7fae39f39700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:53.961 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.959+0000 7fae39f39700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.961 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.959+0000 7fae39f39700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:53.962 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:53.959+0000 7fae39f39700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:54.308 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.305+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:54.308 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.305+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fae3003c7d0 con 0x7fae340802f0 2020-04-02T23:47:54.608 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.606+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae34056ec0 con 0x7fae340802f0 2020-04-02T23:47:54.787 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.784+0000 7fae3a73a700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:54.787 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.784+0000 7fae2affd700 1 -- 172.21.15.190:0/3519469362 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fae3003fdf0 con 0x7fae340802f0 2020-04-02T23:47:54.787 INFO:teuthology.misc.health.smithi190.stdout: 2020-04-02T23:47:54.787 INFO:teuthology.misc.health.smithi190.stdout:{"epoch":11,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:47:52.303482+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:47:54.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 msgr2=0x7fae1c04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:54.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fae24002f30 tx=0x7fae24007a40).stop 2020-04-02T23:47:54.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 msgr2=0x7fae3412f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010bb0).stop 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 shutdown_connections 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fae1c04d570 0x7fae1c04fa80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae34149930 0x7fae3409fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae340802f0 0x7fae3412f490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 --2- 172.21.15.190:0/3519469362 >> v2:172.21.15.78:3300/0 conn(0x7fae34080b60 0x7fae34061d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:54.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 >> 172.21.15.190:0/3519469362 conn(0x7fae3409e4b0 msgr2=0x7fae34149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:54.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 shutdown_connections 2020-04-02T23:47:54.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:47:54.787+0000 7fae3c19d700 1 -- 172.21.15.190:0/3519469362 wait complete. 2020-04-02T23:47:54.804 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:47:59.820 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:07.297 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:47:59.892 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:07.369 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.056 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:07.466 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.126 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:07.536 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.127 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:07.371 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.170 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:07.522 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.187 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:07.313 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.192 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:07.436 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.228 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:07.580 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.246 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:07.372 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.299 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:07.580 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.304 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:07.485 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.359 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:07.641 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.362 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:07.542 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.392 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:07.441 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.436 INFO:tasks.ceph.osd.0.smithi190.stderr:2020-04-02T23:48:00.424+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.448 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:07.497 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.709 INFO:tasks.ceph.osd.1.smithi190.stderr:2020-04-02T23:48:00.695+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.734 INFO:tasks.ceph.osd.4.smithi078.stderr:2020-04-02T23:48:00.723+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.797 INFO:tasks.ceph.osd.2.smithi190.stderr:2020-04-02T23:48:00.784+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.816 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:08.293 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:00.818 INFO:tasks.ceph.osd.6.smithi078.stderr:2020-04-02T23:48:00.805+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.931 INFO:tasks.ceph.osd.3.smithi190.stderr:2020-04-02T23:48:00.920+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:00.936 INFO:tasks.ceph.osd.5.smithi078.stderr:2020-04-02T23:48:00.924+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:01.019 INFO:tasks.ceph.osd.7.smithi078.stderr:2020-04-02T23:48:01.003+0000 9c34ec0 -1 Falling back to public interface 2020-04-02T23:48:01.114 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:48:01.126 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:08.536 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.131 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:01.155 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:08.397 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.156 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:01.184 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:01.200 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:08.553 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.262 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:08.388 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.285 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:08.763 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.342 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:08.624 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.350 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:08.827 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.375 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:08.555 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.478 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:08.526 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.584 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:08.994 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.610 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:01.631 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:08.870 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.632 INFO:teuthology.orchestra.run.smithi190:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:48:01.652 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:09.062 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.691 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:08.935 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.708 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:09.060 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.719 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:08.845 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.787 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.770+0000 7f7e9d9f9700 1 Processor -- start 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.770+0000 7f7e9d9f9700 1 -- start start 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.771+0000 7f7e9d9f9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e98149930 0x7f7e98149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.771+0000 7f7e9d9f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7e980802f0 0x7f7e98080700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.771+0000 7f7e9d9f9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e98149500 con 0x7f7e98080b60 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.771+0000 7f7e9d9f9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980a6670 con 0x7f7e980802f0 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.771+0000 7f7e9d9f9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980a28f0 con 0x7f7e98149930 2020-04-02T23:48:01.788 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.772+0000 7f7e977fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e98149930 0x7f7e98149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.772+0000 7f7e977fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e98149930 0x7f7e98149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60110/0 (socket says 172.21.15.190:60110) 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.772+0000 7f7e977fe700 1 -- 172.21.15.190:0/1110385324 learned_addr learned my addr 172.21.15.190:0/1110385324 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.773+0000 7f7e96ffd700 1 --2- 172.21.15.190:0/1110385324 >> v2:172.21.15.78:3300/0 conn(0x7f7e980802f0 0x7f7e98080700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.775+0000 7f7e977fe700 1 -- 172.21.15.190:0/1110385324 >> v2:172.21.15.78:3300/0 conn(0x7f7e980802f0 msgr2=0x7f7e98080700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.775+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> v2:172.21.15.78:3300/0 conn(0x7f7e980802f0 0x7f7e98080700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.775+0000 7f7e977fe700 1 -- 172.21.15.190:0/1110385324 >> v1:172.21.15.78:6789/0 conn(0x7f7e98080b60 legacy=0x7f7e980a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:01.789 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.775+0000 7f7e977fe700 1 -- 172.21.15.190:0/1110385324 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980a2b90 con 0x7f7e98149930 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.776+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> v2:172.21.15.190:3300/0 conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.777+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> v2:172.21.15.190:3300/0 conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.777+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).ready entity=mon.1 client_cookie=175da7d1adf35253 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.780+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.780+0000 7f7e967fc700 1 -- 172.21.15.190:0/1110385324 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e88011630 con 0x7f7e98149930 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.790 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e977fe700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e967fc700 1 -- 172.21.15.190:0/1110385324 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88011790 con 0x7f7e98149930 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e967fc700 1 -- 172.21.15.190:0/1110385324 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e88011b70 con 0x7f7e98149930 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 msgr2=0x7f7e98149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.783+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f7e9805f0d0 tx=0x7f7e88007a40).stop 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/1110385324 shutdown_connections 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/1110385324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e98149930 0x7f7e98149d40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:01.791 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/1110385324 >> v2:172.21.15.78:3300/0 conn(0x7f7e980802f0 0x7f7e98080700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:01.792 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/1110385324 >> 172.21.15.190:0/1110385324 conn(0x7f7e9809e4b0 msgr2=0x7f7e9809e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:01.792 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/1110385324 shutdown_connections 2020-04-02T23:48:01.792 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.784+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/1110385324 wait complete. 2020-04-02T23:48:01.795 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.786+0000 7f7e9d9f9700 1 Processor -- start 2020-04-02T23:48:01.795 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.786+0000 7f7e9d9f9700 1 -- start start 2020-04-02T23:48:01.795 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e9d9f9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7e98080b60 0x7f7e981329d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:01.795 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e9d9f9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e9d9f9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e98133860 con 0x7f7e980802f0 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e9d9f9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e981335c0 con 0x7f7e98080b60 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e9d9f9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9812f4f0 con 0x7f7e98149930 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.787+0000 7f7e977fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7e980802f0 0x7f7e981228e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53334/0 (socket says 172.21.15.190:53334) 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.788+0000 7f7e977fe700 1 -- 172.21.15.190:0/4274449630 learned_addr learned my addr 172.21.15.190:0/4274449630 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.788+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:01.796 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.788+0000 7f7e96ffd700 1 --2- 172.21.15.190:0/4274449630 >> v2:172.21.15.78:3300/0 conn(0x7f7e98080b60 0x7f7e981329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.790+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192640654 0 0) 0x7f7e98133860 con 0x7f7e980802f0 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.790+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e70003230 con 0x7f7e980802f0 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.792+0000 7f7e97fff700 1 -- 172.21.15.190:0/4274449630 >> v2:172.21.15.78:3300/0 conn(0x7f7e98080b60 msgr2=0x7f7e981329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.792+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> v2:172.21.15.78:3300/0 conn(0x7f7e98080b60 0x7f7e981329d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.792+0000 7f7e97fff700 1 -- 172.21.15.190:0/4274449630 >> v1:172.21.15.190:6789/0 conn(0x7f7e980802f0 legacy=0x7f7e981228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.792+0000 7f7e97fff700 1 -- 172.21.15.190:0/4274449630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98133290 con 0x7f7e98149930 2020-04-02T23:48:01.797 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.792+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.798 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.794+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.798 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.794+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:01.798 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:09.150 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.802 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.798+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.802 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.798+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.802 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.798+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e90008160 con 0x7f7e98149930 2020-04-02T23:48:01.802 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.798+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.802 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.799+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90013060 con 0x7f7e98149930 2020-04-02T23:48:01.803 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.799+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e900084b0 con 0x7f7e98149930 2020-04-02T23:48:01.803 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.799+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e98147790 con 0x7f7e98149930 2020-04-02T23:48:01.803 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.799+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9812fb50 con 0x7f7e98149930 2020-04-02T23:48:01.804 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.800+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e98056ec0 con 0x7f7e98149930 2020-04-02T23:48:01.817 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:08.944 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.845 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:09.026 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.853 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.852+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.854 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.852+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7e900086e0 con 0x7f7e98149930 2020-04-02T23:48:01.854 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.852+0000 7f7e8ffff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:01.855 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.853+0000 7f7e977fe700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:01.855 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.853+0000 7f7e977fe700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e88000b80 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.855 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.853+0000 7f7e977fe700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e88000b80 tx=0x7f7e88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:01.855 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:01.853+0000 7f7e977fe700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f7e88000b80 tx=0x7f7e88007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:01.871 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:09.153 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.915 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:09.096 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:01.948 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:09.230 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:02.003 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.001+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:02.003 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.001+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7f7e90040920 con 0x7f7e98149930 2020-04-02T23:48:02.003 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.001+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:02.004 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.001+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7e9003ccc0 con 0x7f7e98149930 2020-04-02T23:48:02.065 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:09.114 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:02.141 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:09.190 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:02.229 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.227+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e980ac240 con 0x7f7e98149930 2020-04-02T23:48:02.315 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.312+0000 7f7e97fff700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:02.315 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.312+0000 7f7e8ffff700 1 -- 172.21.15.190:0/4274449630 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f7e900402e0 con 0x7f7e98149930 2020-04-02T23:48:02.315 INFO:teuthology.misc.health.smithi190.stdout: 2020-04-02T23:48:02.315 INFO:teuthology.misc.health.smithi190.stdout:{"epoch":11,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:47:52.303482+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:02.317 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.314+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 msgr2=0x7f7e7004fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:02.317 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f7e88000b80 tx=0x7f7e88007a40).stop 2020-04-02T23:48:02.317 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 msgr2=0x7f7e98132e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:02.317 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f7e90002360 tx=0x7f7e90010b50).stop 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 shutdown_connections 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7e7004d930 0x7f7e7004fe40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/4274449630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7e98149930 0x7f7e98132e30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 --2- 172.21.15.190:0/4274449630 >> v2:172.21.15.78:3300/0 conn(0x7f7e98080b60 0x7f7e981329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 >> 172.21.15.190:0/4274449630 conn(0x7f7e9809e4b0 msgr2=0x7f7e98149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 shutdown_connections 2020-04-02T23:48:02.318 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:02.315+0000 7f7e9d9f9700 1 -- 172.21.15.190:0/4274449630 wait complete. 2020-04-02T23:48:02.329 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:48:04.984 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:12.461 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:04.989 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:12.466 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.090 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:12.500 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.097 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:12.507 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.314 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:12.667 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.321 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:12.673 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.348 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:12.630 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.353 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:12.635 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.401 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:12.528 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.406 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:12.532 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.449 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:12.693 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.454 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:12.698 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.516 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:12.565 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.521 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:12.570 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.725 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:12.903 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.729 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:12.910 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.780 INFO:tasks.ceph.osd.0.smithi190.stderr:==00:00:00:13.258 24459== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.895 INFO:tasks.ceph.osd.1.smithi190.stderr:==00:00:00:13.305 24511== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:05.925 INFO:tasks.ceph.osd.2.smithi190.stderr:==00:00:00:13.277 24534== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:06.156 INFO:tasks.ceph.osd.3.smithi190.stderr:==00:00:00:13.438 24546== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:06.185 INFO:tasks.ceph.osd.6.smithi078.stderr:==00:00:00:13.311 25716== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:06.256 INFO:tasks.ceph.osd.4.smithi078.stderr:==00:00:00:13.500 25645== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:06.311 INFO:tasks.ceph.osd.7.smithi078.stderr:==00:00:00:13.360 25729== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:06.393 INFO:tasks.ceph.osd.5.smithi078.stderr:==00:00:00:13.573 25698== Warning: unimplemented fcntl command: 1038 2020-04-02T23:48:08.142 INFO:tasks.ceph.osd.0.smithi190.stderr:2020-04-02T23:48:08.137+0000 9c34ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-02T23:48:08.327 INFO:tasks.ceph.osd.2.smithi190.stderr:2020-04-02T23:48:08.322+0000 9c34ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-02T23:48:08.363 INFO:tasks.ceph.osd.1.smithi190.stderr:2020-04-02T23:48:08.358+0000 9c34ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-02T23:48:08.665 INFO:tasks.ceph.osd.4.smithi078.stderr:2020-04-02T23:48:08.659+0000 9c34ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-02T23:48:08.670 INFO:tasks.ceph.osd.3.smithi190.stderr:2020-04-02T23:48:08.655+0000 9c34ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-02T23:48:08.704 INFO:tasks.ceph.osd.6.smithi078.stderr:2020-04-02T23:48:08.642+0000 9c34ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-02T23:48:08.770 INFO:tasks.ceph.osd.7.smithi078.stderr:2020-04-02T23:48:08.758+0000 9c34ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-02T23:48:08.833 INFO:tasks.ceph.osd.5.smithi078.stderr:2020-04-02T23:48:08.828+0000 9c34ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-02T23:48:09.137 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:09.154 INFO:teuthology.orchestra.run.smithi190:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:48:09.328 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.305+0000 7fad263a4700 1 Processor -- start 2020-04-02T23:48:09.328 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.305+0000 7fad263a4700 1 -- start start 2020-04-02T23:48:09.328 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.306+0000 7fad263a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:09.328 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.306+0000 7fad263a4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad20080b60 0x7fad20150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:09.331 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.306+0000 7fad263a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad20149500 con 0x7fad20149930 2020-04-02T23:48:09.331 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.306+0000 7fad263a4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200a6670 con 0x7fad20080b60 2020-04-02T23:48:09.331 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.306+0000 7fad263a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200a28f0 con 0x7fad200802f0 2020-04-02T23:48:09.331 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.307+0000 7fad24941700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fad20149930 0x7fad20149d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53342/0 (socket says 172.21.15.190:53342) 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.307+0000 7fad24941700 1 -- 172.21.15.190:0/1464754907 learned_addr learned my addr 172.21.15.190:0/1464754907 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.307+0000 7fad25142700 1 --2- 172.21.15.190:0/1464754907 >> v2:172.21.15.78:3300/0 conn(0x7fad20080b60 0x7fad20150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.307+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1f7fe700 1 -- 172.21.15.190:0/1464754907 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258804938 0 0) 0x7fad20149500 con 0x7fad20149930 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1f7fe700 1 -- 172.21.15.190:0/1464754907 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad10003230 con 0x7fad20149930 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1ffff700 1 -- 172.21.15.190:0/1464754907 >> v2:172.21.15.78:3300/0 conn(0x7fad20080b60 msgr2=0x7fad20150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:09.332 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> v2:172.21.15.78:3300/0 conn(0x7fad20080b60 0x7fad20150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1ffff700 1 -- 172.21.15.190:0/1464754907 >> v1:172.21.15.190:6789/0 conn(0x7fad20149930 legacy=0x7fad20149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1ffff700 1 -- 172.21.15.190:0/1464754907 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200a2b90 con 0x7fad200802f0 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.310+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad0c002f30 tx=0x7fad0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.312+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad0c002f30 tx=0x7fad0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.312+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fad0c002f30 tx=0x7fad0c007a40).ready entity=mon.2 client_cookie=ae0e5c1ea94cfc0b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fad0c002f30 tx=0x7fad0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fad0c002f30 tx=0x7fad0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.333 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1f7fe700 1 -- 172.21.15.190:0/1464754907 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c011310 con 0x7fad200802f0 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1ffff700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fad0c002f30 tx=0x7fad0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1f7fe700 1 -- 172.21.15.190:0/1464754907 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c011470 con 0x7fad200802f0 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad1f7fe700 1 -- 172.21.15.190:0/1464754907 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0c011890 con 0x7fad200802f0 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad263a4700 1 -- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 msgr2=0x7fad20080700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.317+0000 7fad263a4700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fad0c002f30 tx=0x7fad0c007a40).stop 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 -- 172.21.15.190:0/1464754907 shutdown_connections 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 --2- 172.21.15.190:0/1464754907 >> v2:172.21.15.78:3300/0 conn(0x7fad20080b60 0x7fad20150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:09.334 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 --2- 172.21.15.190:0/1464754907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad200802f0 0x7fad20080700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 -- 172.21.15.190:0/1464754907 >> 172.21.15.190:0/1464754907 conn(0x7fad2009e4b0 msgr2=0x7fad2009e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 -- 172.21.15.190:0/1464754907 shutdown_connections 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.318+0000 7fad263a4700 1 -- 172.21.15.190:0/1464754907 wait complete. 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.319+0000 7fad263a4700 1 Processor -- start 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.319+0000 7fad263a4700 1 -- start start 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad263a4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad20149930 0x7fad20131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:09.335 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad263a4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad20131910 con 0x7fad200802f0 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad263a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2012f2c0 con 0x7fad20080b60 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad263a4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2012e320 con 0x7fad20149930 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad1ffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fad20080b60 0x7fad2012ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53356/0 (socket says 172.21.15.190:53356) 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.320+0000 7fad1ffff700 1 -- 172.21.15.190:0/4094948521 learned_addr learned my addr 172.21.15.190:0/4094948521 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.321+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> v2:172.21.15.78:3300/0 conn(0x7fad20149930 0x7fad20131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.323+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121802553 0 0) 0x7fad2012f2c0 con 0x7fad20080b60 2020-04-02T23:48:09.336 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.323+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad04002fe0 con 0x7fad20080b60 2020-04-02T23:48:09.338 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.324+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402953239 0 0) 0x7fad20131910 con 0x7fad200802f0 2020-04-02T23:48:09.338 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.324+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2012f2c0 con 0x7fad200802f0 2020-04-02T23:48:09.339 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.328+0000 7fad25142700 1 -- 172.21.15.190:0/4094948521 >> v1:172.21.15.190:6789/0 conn(0x7fad20080b60 legacy=0x7fad2012ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.340 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.328+0000 7fad25142700 1 -- 172.21.15.190:0/4094948521 >> v1:172.21.15.78:6789/0 conn(0x7fad200802f0 legacy=0x7fad20148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.340 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.328+0000 7fad25142700 1 -- 172.21.15.190:0/4094948521 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad201494a0 con 0x7fad20149930 2020-04-02T23:48:09.340 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.329+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> v2:172.21.15.78:3300/0 conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.340 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.330+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> v2:172.21.15.78:3300/0 conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.340 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.330+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:09.341 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.338+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.341 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.341 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1800e350 con 0x7fad20149930 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18005c30 con 0x7fad20149930 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1800c900 con 0x7fad20149930 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad20131b40 con 0x7fad20149930 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.339+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200aabc0 con 0x7fad20149930 2020-04-02T23:48:09.342 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.340+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf8003340 con 0x7fad20149930 2020-04-02T23:48:09.360 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.357+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.360 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.358+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fad1800cb70 con 0x7fad20149930 2020-04-02T23:48:09.362 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.358+0000 7fad1d7fa700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:09.362 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad24941700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:09.362 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad24941700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad14000e90 tx=0x7fad14001610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.362 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad24941700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad14000e90 tx=0x7fad14001610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.363 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad24941700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fad14000e90 tx=0x7fad14001610).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:09.363 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.363 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.359+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fad180401e0 con 0x7fad20149930 2020-04-02T23:48:09.679 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.677+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.680 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.677+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fad1803c580 con 0x7fad20149930 2020-04-02T23:48:09.846 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.844+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf80021d0 con 0x7fad20149930 2020-04-02T23:48:09.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.922+0000 7fad25142700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:09.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.922+0000 7fad1d7fa700 1 -- 172.21.15.190:0/4094948521 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fad1803fba0 con 0x7fad20149930 2020-04-02T23:48:09.925 INFO:teuthology.misc.health.smithi190.stdout: 2020-04-02T23:48:09.925 INFO:teuthology.misc.health.smithi190.stdout:{"epoch":11,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:47:52.303482+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:09.931 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 msgr2=0x7fad04051080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.931 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fad14000e90 tx=0x7fad14001610).stop 2020-04-02T23:48:09.931 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 msgr2=0x7fad20131fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fad180032b0 tx=0x7fad18010ec0).stop 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 shutdown_connections 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fad0404eb70 0x7fad04051080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 --2- 172.21.15.190:0/4094948521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad20149930 0x7fad20131fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 >> 172.21.15.190:0/4094948521 conn(0x7fad2009e4b0 msgr2=0x7fad2006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:09.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 shutdown_connections 2020-04-02T23:48:09.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:09.925+0000 7fad263a4700 1 -- 172.21.15.190:0/4094948521 wait complete. 2020-04-02T23:48:09.937 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:48:11.634 INFO:tasks.ceph.osd.4.smithi078.stderr:2020-04-02T23:48:11.620+0000 278bd700 -1 osd.4 0 waiting for initial osdmap 2020-04-02T23:48:11.640 INFO:tasks.ceph.osd.7.smithi078.stderr:2020-04-02T23:48:11.634+0000 27ac2700 -1 osd.7 0 waiting for initial osdmap 2020-04-02T23:48:11.649 INFO:tasks.ceph.osd.0.smithi190.stderr:2020-04-02T23:48:11.643+0000 27ac2700 -1 osd.0 0 waiting for initial osdmap 2020-04-02T23:48:11.667 INFO:tasks.ceph.osd.3.smithi190.stderr:2020-04-02T23:48:11.653+0000 27ac2700 -1 osd.3 0 waiting for initial osdmap 2020-04-02T23:48:11.731 INFO:tasks.ceph.osd.1.smithi190.stderr:2020-04-02T23:48:11.725+0000 27ac2700 -1 osd.1 0 waiting for initial osdmap 2020-04-02T23:48:11.800 INFO:tasks.ceph.osd.6.smithi078.stderr:2020-04-02T23:48:11.794+0000 278bd700 -1 osd.6 0 waiting for initial osdmap 2020-04-02T23:48:11.819 INFO:tasks.ceph.osd.2.smithi190.stderr:2020-04-02T23:48:11.811+0000 27ac2700 -1 osd.2 0 waiting for initial osdmap 2020-04-02T23:48:12.750 INFO:tasks.ceph.osd.5.smithi078.stderr:2020-04-02T23:48:12.730+0000 27ac2700 -1 osd.5 0 waiting for initial osdmap 2020-04-02T23:48:16.746 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:16.761 INFO:teuthology.orchestra.run.smithi190:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:48:16.918 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 Processor -- start 2020-04-02T23:48:16.918 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 -- start start 2020-04-02T23:48:16.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb46409f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:16.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640a7a40 con 0x7fb4640a7170 2020-04-02T23:48:16.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640a77a0 con 0x7fb4640674b0 2020-04-02T23:48:16.919 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.894+0000 7fb46a8d1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4640a7580 con 0x7fb46405f3e0 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.895+0000 7fb46bb33700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb4640674b0 0x7fb4640678c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53576/0 (socket says 172.21.15.190:53576) 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.895+0000 7fb46bb33700 1 -- 172.21.15.190:0/3351604940 learned_addr learned my addr 172.21.15.190:0/3351604940 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.895+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb46409f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.898+0000 7fb4690ce700 1 -- 172.21.15.190:0/3351604940 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330263531 0 0) 0x7fb4640a77a0 con 0x7fb4640674b0 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.898+0000 7fb4690ce700 1 -- 172.21.15.190:0/3351604940 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb450003230 con 0x7fb4640674b0 2020-04-02T23:48:16.920 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.899+0000 7fb46a0d0700 1 -- 172.21.15.190:0/3351604940 >> v1:172.21.15.190:6789/0 conn(0x7fb4640674b0 legacy=0x7fb4640678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.899+0000 7fb46a0d0700 1 -- 172.21.15.190:0/3351604940 >> v1:172.21.15.78:6789/0 conn(0x7fb4640a7170 legacy=0x7fb46409fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.899+0000 7fb46a0d0700 1 -- 172.21.15.190:0/3351604940 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46409fa30 con 0x7fb46405f3e0 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.900+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.903+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.903+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).ready entity=mon.0 client_cookie=e3d4a5f62c6896f1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.906+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.921 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.906+0000 7fb4690ce700 1 -- 172.21.15.190:0/3351604940 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4600113c0 con 0x7fb46405f3e0 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb4690ce700 1 -- 172.21.15.190:0/3351604940 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460011520 con 0x7fb46405f3e0 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb4690ce700 1 -- 172.21.15.190:0/3351604940 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb460011880 con 0x7fb46405f3e0 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb46a8d1700 1 -- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 msgr2=0x7fb46409f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.914+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).stop 2020-04-02T23:48:16.922 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.915+0000 7fb46a8d1700 1 -- 172.21.15.190:0/3351604940 shutdown_connections 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.915+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/3351604940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb46409f400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.915+0000 7fb46a8d1700 1 -- 172.21.15.190:0/3351604940 >> 172.21.15.190:0/3351604940 conn(0x7fb4640ac8a0 msgr2=0x7fb4640accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.915+0000 7fb46a8d1700 1 -- 172.21.15.190:0/3351604940 shutdown_connections 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.915+0000 7fb46a8d1700 1 -- 172.21.15.190:0/3351604940 wait complete. 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.916+0000 7fb46a8d1700 1 Processor -- start 2020-04-02T23:48:16.923 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.916+0000 7fb46a8d1700 1 -- start start 2020-04-02T23:48:16.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb46a8d1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb4640a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:16.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb46a8d1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4640a7170 0x7fb464065100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:16.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb46a8d1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb464136c70 con 0x7fb4640674b0 2020-04-02T23:48:16.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb46a8d1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4640a3870 con 0x7fb46405f3e0 2020-04-02T23:48:16.925 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb46a8d1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464065810 con 0x7fb4640a7170 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.917+0000 7fb4698cf700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb4640674b0 0x7fb464133e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53584/0 (socket says 172.21.15.190:53584) 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.918+0000 7fb4698cf700 1 -- 172.21.15.190:0/531516096 learned_addr learned my addr 172.21.15.190:0/531516096 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.918+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb4640a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.918+0000 7fb46bb33700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4640a7170 0x7fb464065100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.920+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294298688 0 0) 0x7fb464136c70 con 0x7fb4640674b0 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.920+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c003230 con 0x7fb4640674b0 2020-04-02T23:48:16.926 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.921+0000 7fb46a0d0700 1 -- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4640a7170 msgr2=0x7fb464065100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.927 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.921+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4640a7170 0x7fb464065100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:16.927 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.921+0000 7fb46a0d0700 1 -- 172.21.15.190:0/531516096 >> v1:172.21.15.190:6789/0 conn(0x7fb4640674b0 legacy=0x7fb464133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:16.927 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.922+0000 7fb46a0d0700 1 -- 172.21.15.190:0/531516096 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4641336e0 con 0x7fb46405f3e0 2020-04-02T23:48:16.927 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.922+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.927 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.924+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> v2:172.21.15.78:3300/0 conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.928 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.925+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:16.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.932 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46000f700 con 0x7fb46405f3e0 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000f860 con 0x7fb46405f3e0 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb460007340 con 0x7fb46405f3e0 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464133980 con 0x7fb46405f3e0 2020-04-02T23:48:16.933 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.929+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641345b0 con 0x7fb46405f3e0 2020-04-02T23:48:16.934 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.931+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464056ec0 con 0x7fb46405f3e0 2020-04-02T23:48:16.995 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.994+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.996 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.994+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb4600074a0 con 0x7fb46405f3e0 2020-04-02T23:48:16.996 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.994+0000 7fb456ffd700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:16.997 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.994+0000 7fb4698cf700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:16.997 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.995+0000 7fb4698cf700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb458001290 tx=0x7fb458001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.997 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.995+0000 7fb4698cf700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb458001290 tx=0x7fb458001ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.998 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.995+0000 7fb4698cf700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fb458001290 tx=0x7fb458001ad0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:16.999 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.997+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:16.999 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:16.997+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fb460040d70 con 0x7fb46405f3e0 2020-04-02T23:48:17.138 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.136+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.139 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.136+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb46003d110 con 0x7fb46405f3e0 2020-04-02T23:48:17.277 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.276+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb464133b10 con 0x7fb46405f3e0 2020-04-02T23:48:17.303 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.301+0000 7fb46a0d0700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.303 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.301+0000 7fb456ffd700 1 -- 172.21.15.190:0/531516096 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11853 (secure 0 0 0) 0x7fb460040730 con 0x7fb46405f3e0 2020-04-02T23:48:17.303 INFO:teuthology.misc.health.smithi190.stdout: 2020-04-02T23:48:17.303 INFO:teuthology.misc.health.smithi190.stdout:{"epoch":18,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:16.720417+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 msgr2=0x7fb44c04fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fb458001290 tx=0x7fb458001ad0).stop 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 msgr2=0x7fb4640a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fb460002f30 tx=0x7fb460007a40).stop 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 shutdown_connections 2020-04-02T23:48:17.305 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb44c04d9b0 0x7fb44c04fec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.306 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4640a7170 0x7fb464065100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.306 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 --2- 172.21.15.190:0/531516096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb46405f3e0 0x7fb4640a3410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.306 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 >> 172.21.15.190:0/531516096 conn(0x7fb4640ac8a0 msgr2=0x7fb46409fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:17.306 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 shutdown_connections 2020-04-02T23:48:17.306 INFO:teuthology.misc.health.smithi190.stderr:2020-04-02T23:48:17.302+0000 7fb46a8d1700 1 -- 172.21.15.190:0/531516096 wait complete. 2020-04-02T23:48:17.315 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-02T23:48:17.316 INFO:tasks.ceph:Creating RBD pool 2020-04-02T23:48:17.316 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:17.329 INFO:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-02T23:48:17.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 Processor -- start 2020-04-02T23:48:17.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 -- start start 2020-04-02T23:48:17.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52e00a6b20 0x7f52e00a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:17.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:17.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e00a7d00 con 0x7f52e005b750 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e00a6140 con 0x7f52e00a6b20 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.474+0000 7f52e6606700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e00a63e0 con 0x7f52e014dc40 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.475+0000 7f52e53a4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.475+0000 7f52dffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52e00a6b20 0x7f52e00a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.475+0000 7f52e53a4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60370/0 (socket says 172.21.15.190:60370) 2020-04-02T23:48:17.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.475+0000 7f52e53a4700 1 -- 172.21.15.190:0/3508781639 learned_addr learned my addr 172.21.15.190:0/3508781639 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:17.497 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.478+0000 7f52e53a4700 1 -- 172.21.15.190:0/3508781639 >> v2:172.21.15.78:3300/0 conn(0x7f52e00a6b20 msgr2=0x7f52e00a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:17.497 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.478+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> v2:172.21.15.78:3300/0 conn(0x7f52e00a6b20 0x7f52e00a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:17.497 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.478+0000 7f52e53a4700 1 -- 172.21.15.190:0/3508781639 >> v1:172.21.15.78:6789/0 conn(0x7f52e005b750 legacy=0x7f52e00a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:17.497 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.478+0000 7f52e53a4700 1 -- 172.21.15.190:0/3508781639 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e00a6680 con 0x7f52e014dc40 2020-04-02T23:48:17.497 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.478+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.479+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.479+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).ready entity=mon.1 client_cookie=852992c1c41fc491 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.482+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.482+0000 7f52df7fe700 1 -- 172.21.15.190:0/3508781639 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8011ea0 con 0x7f52e014dc40 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52e53a4700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.498 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52df7fe700 1 -- 172.21.15.190:0/3508781639 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800a160 con 0x7f52e014dc40 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52df7fe700 1 -- 172.21.15.190:0/3508781639 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800a540 con 0x7f52e014dc40 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52e6606700 1 -- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 msgr2=0x7f52e0150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.491+0000 7f52e6606700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).stop 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 -- 172.21.15.190:0/3508781639 shutdown_connections 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 --2- 172.21.15.190:0/3508781639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0150060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 --2- 172.21.15.190:0/3508781639 >> v2:172.21.15.78:3300/0 conn(0x7f52e00a6b20 0x7f52e00a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:17.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 -- 172.21.15.190:0/3508781639 >> 172.21.15.190:0/3508781639 conn(0x7f52e00ab4f0 msgr2=0x7f52e00ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:17.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 -- 172.21.15.190:0/3508781639 shutdown_connections 2020-04-02T23:48:17.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.492+0000 7f52e6606700 1 -- 172.21.15.190:0/3508781639 wait complete. 2020-04-02T23:48:17.501 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.493+0000 7f52e6606700 1 Processor -- start 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.493+0000 7f52e6606700 1 -- start start 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e6606700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52e005b750 0x7f52e0067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e6606700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e6606700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e0126f60 con 0x7f52e00a6b20 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e6606700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e0127200 con 0x7f52e014dc40 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e6606700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e01274a0 con 0x7f52e005b750 2020-04-02T23:48:17.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e53a4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52e4ba3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52e005b750 0x7f52e0067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.494+0000 7f52dffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f52e00a6b20 0x7f52e007f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53596/0 (socket says 172.21.15.190:53596) 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.495+0000 7f52dffff700 1 -- 172.21.15.190:0/2872047046 learned_addr learned my addr 172.21.15.190:0/2872047046 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.498+0000 7f52e53a4700 1 -- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52e005b750 msgr2=0x7f52e0067510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.498+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52e005b750 0x7f52e0067510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:17.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.498+0000 7f52e53a4700 1 -- 172.21.15.190:0/2872047046 >> v1:172.21.15.190:6789/0 conn(0x7f52e00a6b20 legacy=0x7f52e007f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:17.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.498+0000 7f52e53a4700 1 -- 172.21.15.190:0/2872047046 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0067970 con 0x7f52e014dc40 2020-04-02T23:48:17.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.499+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.501+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> v2:172.21.15.190:3300/0 conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.505 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.501+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.520 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.520 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.520 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8005a40 con 0x7f52e014dc40 2020-04-02T23:48:17.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8005ba0 con 0x7f52e014dc40 2020-04-02T23:48:17.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e007fd50 con 0x7f52e014dc40 2020-04-02T23:48:17.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8007150 con 0x7f52e014dc40 2020-04-02T23:48:17.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.507+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e00a06e0 con 0x7f52e014dc40 2020-04-02T23:48:17.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.508+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e00a0990 con 0x7f52e014dc40 2020-04-02T23:48:17.525 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.523+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.524+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f52d80072b0 con 0x7f52e014dc40 2020-04-02T23:48:17.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.524+0000 7f52dd7fa700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:17.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.524+0000 7f52e4ba3700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:17.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.524+0000 7f52e4ba3700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52d0001f50 tx=0x7f52d0003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.525+0000 7f52e4ba3700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52d0001f50 tx=0x7f52d0003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.525+0000 7f52e4ba3700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f52d0001f50 tx=0x7f52d0003960).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:17.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.641+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.641+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f52d80855e0 con 0x7f52e014dc40 2020-04-02T23:48:17.698 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.696+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:17.698 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.696+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f52d8081980 con 0x7f52e014dc40 2020-04-02T23:48:17.849 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:17.847+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f52e0126d70 con 0x7f52e014dc40 2020-04-02T23:48:18.496 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.495+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:18.962 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.961+0000 7f52e53a4700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:18.963 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.961+0000 7f52dd7fa700 1 -- 172.21.15.190:0/2872047046 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f52d8084fa0 con 0x7f52e014dc40 2020-04-02T23:48:18.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.962+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 msgr2=0x7f52c004f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:18.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.962+0000 7f52e6606700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f52d0001f50 tx=0x7f52d0003960).stop 2020-04-02T23:48:18.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.962+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 msgr2=0x7f52e0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.962+0000 7f52e6606700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f52e0060d90 tx=0x7f52d8007dc0).stop 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 shutdown_connections 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f52c004d490 0x7f52c004f9a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52e014dc40 0x7f52e0138d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 --2- 172.21.15.190:0/2872047046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52e005b750 0x7f52e0067510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 >> 172.21.15.190:0/2872047046 conn(0x7f52e00ab4f0 msgr2=0x7f52e006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:18.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 shutdown_connections 2020-04-02T23:48:18.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:18.963+0000 7f52e6606700 1 -- 172.21.15.190:0/2872047046 wait complete. 2020-04-02T23:48:18.967 INFO:teuthology.orchestra.run.smithi190.stderr:pool 'rbd' created 2020-04-02T23:48:18.976 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:18.990 INFO:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 Processor -- start 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 -- start start 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe9a40a6b20 0x7fe9a40a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40a7d00 con 0x7fe9a405b750 2020-04-02T23:48:19.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40a6140 con 0x7fe9a40a6b20 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.159+0000 7fe9ac2a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40a63e0 con 0x7fe9a414dc40 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.160+0000 7fe9ab042700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.160+0000 7fe9aa040700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe9a40a6b20 0x7fe9a40a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.160+0000 7fe9ab042700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46240/0 (socket says 172.21.15.190:46240) 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.160+0000 7fe9ab042700 1 -- 172.21.15.190:0/2440692426 learned_addr learned my addr 172.21.15.190:0/2440692426 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.163+0000 7fe9ab042700 1 -- 172.21.15.190:0/2440692426 >> v2:172.21.15.190:3300/0 conn(0x7fe9a40a6b20 msgr2=0x7fe9a40a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:19.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.163+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> v2:172.21.15.190:3300/0 conn(0x7fe9a40a6b20 0x7fe9a40a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.163+0000 7fe9ab042700 1 -- 172.21.15.190:0/2440692426 >> v1:172.21.15.190:6789/0 conn(0x7fe9a405b750 legacy=0x7fe9a40a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.163+0000 7fe9ab042700 1 -- 172.21.15.190:0/2440692426 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40a6680 con 0x7fe9a414dc40 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.163+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.166+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.166+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).ready entity=mon.2 client_cookie=aefcac77614dc1ba server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9ab042700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9a983f700 1 -- 172.21.15.190:0/2440692426 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99c00a160 con 0x7fe9a414dc40 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9a983f700 1 -- 172.21.15.190:0/2440692426 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c00a2c0 con 0x7fe9a414dc40 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9a983f700 1 -- 172.21.15.190:0/2440692426 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99c00a6a0 con 0x7fe9a414dc40 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 msgr2=0x7fe9a4150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.177+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fe99c0032b0 tx=0x7fe99c007dc0).stop 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/2440692426 shutdown_connections 2020-04-02T23:48:19.184 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/2440692426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a414dc40 0x7fe9a4150060 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:19.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/2440692426 >> v2:172.21.15.190:3300/0 conn(0x7fe9a40a6b20 0x7fe9a40a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:19.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/2440692426 >> 172.21.15.190:0/2440692426 conn(0x7fe9a40ab4f0 msgr2=0x7fe9a40ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:19.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/2440692426 shutdown_connections 2020-04-02T23:48:19.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.178+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/2440692426 wait complete. 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.179+0000 7fe9ac2a4700 1 Processor -- start 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.179+0000 7fe9ac2a4700 1 -- start start 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9ac2a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9ac2a4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40a05d0 con 0x7fe9a414dc40 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9ac2a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a4124060 con 0x7fe9a405b750 2020-04-02T23:48:19.187 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9ac2a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a4124300 con 0x7fe9a40a6b20 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9aa040700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9aa841700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe9a405b750 0x7fe9a4136860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53608/0 (socket says 172.21.15.190:53608) 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9aa841700 1 -- 172.21.15.190:0/1233779920 learned_addr learned my addr 172.21.15.190:0/1233779920 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.180+0000 7fe9ab042700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe9a414dc40 0x7fe9a40a1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36012/0 (socket says 172.21.15.190:36012) 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.184+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957696985 0 0) 0x7fe9a4124060 con 0x7fe9a405b750 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.184+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe98c003230 con 0x7fe9a405b750 2020-04-02T23:48:19.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.184+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443469122 0 0) 0x7fe9a40a05d0 con 0x7fe9a414dc40 2020-04-02T23:48:19.189 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.184+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a4124060 con 0x7fe9a414dc40 2020-04-02T23:48:19.189 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.185+0000 7fe9aa040700 1 -- 172.21.15.190:0/1233779920 >> v1:172.21.15.190:6789/0 conn(0x7fe9a405b750 legacy=0x7fe9a4136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.189 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.185+0000 7fe9aa040700 1 -- 172.21.15.190:0/1233779920 >> v1:172.21.15.78:6789/0 conn(0x7fe9a414dc40 legacy=0x7fe9a40a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:19.189 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.185+0000 7fe9aa040700 1 -- 172.21.15.190:0/1233779920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40a2190 con 0x7fe9a40a6b20 2020-04-02T23:48:19.190 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.186+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.191 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.189+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.191 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.189+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe994005e90 con 0x7fe9a40a6b20 2020-04-02T23:48:19.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994007160 con 0x7fe9a40a6b20 2020-04-02T23:48:19.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a40a0240 con 0x7fe9a40a6b20 2020-04-02T23:48:19.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe994007500 con 0x7fe9a40a6b20 2020-04-02T23:48:19.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.194+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a4122d00 con 0x7fe9a40a6b20 2020-04-02T23:48:19.198 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.195+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40a0430 con 0x7fe9a40a6b20 2020-04-02T23:48:19.209 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.208+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.210 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.208+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe99400a260 con 0x7fe9a40a6b20 2020-04-02T23:48:19.210 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.208+0000 7fe99b7fe700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:19.211 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.209+0000 7fe9aa841700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:19.211 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.209+0000 7fe9aa841700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9a0000f10 tx=0x7fe9a0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.211 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.209+0000 7fe9aa841700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9a0000f10 tx=0x7fe9a0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.211 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.209+0000 7fe9aa841700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe9a0000f10 tx=0x7fe9a0001760).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:19.214 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.212+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.214 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.212+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5242+0+0 (secure 0 0 0) 0x7fe9940402a0 con 0x7fe9a40a6b20 2020-04-02T23:48:19.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.398+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:19.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.398+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe99403c640 con 0x7fe9a40a6b20 2020-04-02T23:48:19.576 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:19.574+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9a40a03d0 con 0x7fe9a40a6b20 2020-04-02T23:48:20.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.077+0000 7fe9aa040700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.078+0000 7fe99b7fe700 1 -- 172.21.15.190:0/1233779920 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe99400a0c0 con 0x7fe9a40a6b20 2020-04-02T23:48:20.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 msgr2=0x7fe98c04ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe9a0000f10 tx=0x7fe9a0001760).stop 2020-04-02T23:48:20.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 msgr2=0x7fe9a409fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fe994002f30 tx=0x7fe994010bd0).stop 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 shutdown_connections 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe98c04da80 0x7fe98c04ff90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.079+0000 7fe9ac2a4700 1 --2- 172.21.15.190:0/1233779920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a40a6b20 0x7fe9a409fde0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.080+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 >> 172.21.15.190:0/1233779920 conn(0x7fe9a40ab4f0 msgr2=0x7fe9a40a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.080+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 shutdown_connections 2020-04-02T23:48:20.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.080+0000 7fe9ac2a4700 1 -- 172.21.15.190:0/1233779920 wait complete. 2020-04-02T23:48:20.084 INFO:teuthology.orchestra.run.smithi190.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-02T23:48:20.093 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-04-02T23:48:20.093 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:20.108 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:20.275 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.273+0000 7fb83e74e700 1 Processor -- start 2020-04-02T23:48:20.275 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.273+0000 7fb83e74e700 1 -- start start 2020-04-02T23:48:20.276 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.274+0000 7fb83e74e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb83813d460 0x7fb838060390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:20.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.274+0000 7fb83e74e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8380aa8b0 0x7fb8380aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:20.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.274+0000 7fb83e74e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83813d870 con 0x7fb8380607f0 2020-04-02T23:48:20.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.274+0000 7fb83e74e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83813cac0 con 0x7fb83813d460 2020-04-02T23:48:20.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.274+0000 7fb83e74e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb838060c00 con 0x7fb8380aa8b0 2020-04-02T23:48:20.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.275+0000 7fb83cf4b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb8380607f0 0x7fb8380aa1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36016/0 (socket says 172.21.15.190:36016) 2020-04-02T23:48:20.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.275+0000 7fb83cf4b700 1 -- 172.21.15.190:0/2526976727 learned_addr learned my addr 172.21.15.190:0/2526976727 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:20.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.275+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> v2:172.21.15.78:3300/0 conn(0x7fb83813d460 0x7fb838060390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.281 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.279+0000 7fb83d74c700 1 -- 172.21.15.190:0/2526976727 >> v2:172.21.15.190:3300/0 conn(0x7fb8380aa8b0 msgr2=0x7fb8380aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:20.281 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.279+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> v2:172.21.15.190:3300/0 conn(0x7fb8380aa8b0 0x7fb8380aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:20.281 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.279+0000 7fb83d74c700 1 -- 172.21.15.190:0/2526976727 >> v1:172.21.15.78:6789/0 conn(0x7fb8380607f0 legacy=0x7fb8380aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.282 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.279+0000 7fb83d74c700 1 -- 172.21.15.190:0/2526976727 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83813cd20 con 0x7fb83813d460 2020-04-02T23:48:20.282 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.279+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> v2:172.21.15.78:3300/0 conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.286 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.284+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> v2:172.21.15.78:3300/0 conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.286 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.284+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).ready entity=mon.0 client_cookie=9a482f338907692f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb83d74c700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb827fff700 1 -- 172.21.15.190:0/2526976727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830011470 con 0x7fb83813d460 2020-04-02T23:48:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb827fff700 1 -- 172.21.15.190:0/2526976727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8300115d0 con 0x7fb83813d460 2020-04-02T23:48:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb827fff700 1 -- 172.21.15.190:0/2526976727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb830011970 con 0x7fb83813d460 2020-04-02T23:48:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb83e74e700 1 -- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 msgr2=0x7fb838060390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.294+0000 7fb83e74e700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).stop 2020-04-02T23:48:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 -- 172.21.15.190:0/2526976727 shutdown_connections 2020-04-02T23:48:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 --2- 172.21.15.190:0/2526976727 >> v2:172.21.15.190:3300/0 conn(0x7fb8380aa8b0 0x7fb8380aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 --2- 172.21.15.190:0/2526976727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83813d460 0x7fb838060390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 -- 172.21.15.190:0/2526976727 >> 172.21.15.190:0/2526976727 conn(0x7fb838063770 msgr2=0x7fb83805c690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 -- 172.21.15.190:0/2526976727 shutdown_connections 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.295+0000 7fb83e74e700 1 -- 172.21.15.190:0/2526976727 wait complete. 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 Processor -- start 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 -- start start 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 0x7fb838136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb838138800 con 0x7fb8380aa8b0 2020-04-02T23:48:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb838138560 con 0x7fb8380607f0 2020-04-02T23:48:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.296+0000 7fb83e74e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb838146dc0 con 0x7fb83813d460 2020-04-02T23:48:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.297+0000 7fb83d74c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 0x7fb838136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.297+0000 7fb83df4d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.302 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.298+0000 7fb83d74c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 0x7fb838136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60402/0 (socket says 172.21.15.190:60402) 2020-04-02T23:48:20.302 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.298+0000 7fb83d74c700 1 -- 172.21.15.190:0/919407123 learned_addr learned my addr 172.21.15.190:0/919407123 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:20.303 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.301+0000 7fb83df4d700 1 -- 172.21.15.190:0/919407123 >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 msgr2=0x7fb838136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.304 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.301+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 0x7fb838136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.304 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.301+0000 7fb83df4d700 1 -- 172.21.15.190:0/919407123 >> v1:172.21.15.190:6789/0 conn(0x7fb8380aa8b0 legacy=0x7fb838147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.304 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.301+0000 7fb83df4d700 1 -- 172.21.15.190:0/919407123 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380a6360 con 0x7fb83813d460 2020-04-02T23:48:20.304 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.302+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.306 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.304+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.306 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.304+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb828007540 con 0x7fb83813d460 2020-04-02T23:48:20.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828005960 con 0x7fb83813d460 2020-04-02T23:48:20.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb828005d00 con 0x7fb83813d460 2020-04-02T23:48:20.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb838147970 con 0x7fb83813d460 2020-04-02T23:48:20.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.309+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83813bbc0 con 0x7fb83813d460 2020-04-02T23:48:20.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.310+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb838056ec0 con 0x7fb83813d460 2020-04-02T23:48:20.327 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.326+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.328 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.326+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb828008840 con 0x7fb83813d460 2020-04-02T23:48:20.328 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.326+0000 7fb8267fc700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:20.329 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.327+0000 7fb83d74c700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.329 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.327+0000 7fb83d74c700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.329 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.327+0000 7fb83d74c700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.330 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.327+0000 7fb83d74c700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:20.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.371+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.371+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb828040160 con 0x7fb83813d460 2020-04-02T23:48:20.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.550+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.553 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.550+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb82803c500 con 0x7fb83813d460 2020-04-02T23:48:20.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.703+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb838146f90 con 0x7fb83813d460 2020-04-02T23:48:20.734 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.732+0000 7fb83df4d700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.735 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.732+0000 7fb8267fc700 1 -- 172.21.15.190:0/919407123 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13239 (secure 0 0 0) 0x7fb82803fb20 con 0x7fb83813d460 2020-04-02T23:48:20.735 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:20.735 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":20,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:19.990658+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:20.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 msgr2=0x7fb81804fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fb830002f30 tx=0x7fb830007a40).stop 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 msgr2=0x7fb838137fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fb828002f30 tx=0x7fb828010880).stop 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 shutdown_connections 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb81804d560 0x7fb81804fa70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 --2- 172.21.15.190:0/919407123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb83813d460 0x7fb838137fb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 --2- 172.21.15.190:0/919407123 >> v2:172.21.15.190:3300/0 conn(0x7fb8380607f0 0x7fb838136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 >> 172.21.15.190:0/919407123 conn(0x7fb838063770 msgr2=0x7fb83806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:20.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 shutdown_connections 2020-04-02T23:48:20.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.734+0000 7fb83e74e700 1 -- 172.21.15.190:0/919407123 wait complete. 2020-04-02T23:48:20.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:27.771838+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:17.905670+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:48:20.747 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:20.760 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:48:20.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.921+0000 7f360386e700 1 Processor -- start 2020-04-02T23:48:20.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.921+0000 7f360386e700 1 -- start start 2020-04-02T23:48:20.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.922+0000 7f360386e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f35fc0a73d0 0x7f35fc0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:20.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.922+0000 7f360386e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc139940 0x7f35fc139d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:20.925 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.922+0000 7f360386e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0a2c20 con 0x7f35fc09f780 2020-04-02T23:48:20.925 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.922+0000 7f360386e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0a4b90 con 0x7f35fc0a73d0 2020-04-02T23:48:20.925 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.922+0000 7f360386e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0a2e50 con 0x7f35fc139940 2020-04-02T23:48:20.926 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.923+0000 7f3600e09700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f35fc09f780 0x7f35fc0a32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36028/0 (socket says 172.21.15.190:36028) 2020-04-02T23:48:20.926 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.923+0000 7f3600e09700 1 -- 172.21.15.190:0/3163134190 learned_addr learned my addr 172.21.15.190:0/3163134190 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:20.926 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.923+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> v2:172.21.15.190:3300/0 conn(0x7f35fc0a73d0 0x7f35fc0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.926 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.925+0000 7f3601e0b700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc139940 0x7f35fc139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.928 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f35ebfff700 1 -- 172.21.15.190:0/3163134190 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003762053 0 0) 0x7f35fc0a2c20 con 0x7f35fc09f780 2020-04-02T23:48:20.928 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f35ebfff700 1 -- 172.21.15.190:0/3163134190 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e4003230 con 0x7f35fc09f780 2020-04-02T23:48:20.928 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f360160a700 1 -- 172.21.15.190:0/3163134190 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc139940 msgr2=0x7f35fc139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:20.928 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc139940 0x7f35fc139d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:20.929 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f360160a700 1 -- 172.21.15.190:0/3163134190 >> v1:172.21.15.78:6789/0 conn(0x7f35fc09f780 legacy=0x7f35fc0a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.929 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.926+0000 7f360160a700 1 -- 172.21.15.190:0/3163134190 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0a47c0 con 0x7f35fc0a73d0 2020-04-02T23:48:20.929 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.927+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> v2:172.21.15.190:3300/0 conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.930 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.928+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> v2:172.21.15.190:3300/0 conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.930 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.928+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).ready entity=mon.1 client_cookie=a7903e953fbb0f23 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:20.933 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.931+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.934 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.932+0000 7f35ebfff700 1 -- 172.21.15.190:0/3163134190 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f80113c0 con 0x7f35fc0a73d0 2020-04-02T23:48:20.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f360160a700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f35ebfff700 1 -- 172.21.15.190:0/3163134190 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f8011520 con 0x7f35fc0a73d0 2020-04-02T23:48:20.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f35ebfff700 1 -- 172.21.15.190:0/3163134190 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f8011900 con 0x7f35fc0a73d0 2020-04-02T23:48:20.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f360386e700 1 -- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 msgr2=0x7f35fc0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.937 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.934+0000 7f360386e700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).stop 2020-04-02T23:48:20.937 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 -- 172.21.15.190:0/3163134190 shutdown_connections 2020-04-02T23:48:20.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc139940 0x7f35fc139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:20.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 --2- 172.21.15.190:0/3163134190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35fc0a73d0 0x7f35fc0a4360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 -- 172.21.15.190:0/3163134190 >> 172.21.15.190:0/3163134190 conn(0x7f35fc05b3d0 msgr2=0x7f35fc05b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:20.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 -- 172.21.15.190:0/3163134190 shutdown_connections 2020-04-02T23:48:20.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.935+0000 7f360386e700 1 -- 172.21.15.190:0/3163134190 wait complete. 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.936+0000 7f360386e700 1 Processor -- start 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.936+0000 7f360386e700 1 -- start start 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.937+0000 7f360386e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35fc09f780 0x7f35fc148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.937+0000 7f360386e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.937+0000 7f360386e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc148c60 con 0x7f35fc139940 2020-04-02T23:48:20.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.937+0000 7f360386e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc148f00 con 0x7f35fc09f780 2020-04-02T23:48:20.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.937+0000 7f360386e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1491a0 con 0x7f35fc0a73d0 2020-04-02T23:48:20.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.938+0000 7f3601e0b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f35fc139940 0x7f35fc12e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53638/0 (socket says 172.21.15.190:53638) 2020-04-02T23:48:20.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.938+0000 7f3601e0b700 1 -- 172.21.15.190:0/2582565856 learned_addr learned my addr 172.21.15.190:0/2582565856 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:20.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.938+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.938+0000 7f360160a700 1 --2- 172.21.15.190:0/2582565856 >> v2:172.21.15.78:3300/0 conn(0x7f35fc09f780 0x7f35fc148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:20.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.941+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316575617 0 0) 0x7f35fc148c60 con 0x7f35fc139940 2020-04-02T23:48:20.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.941+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc002fe0 con 0x7f35fc139940 2020-04-02T23:48:20.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.942+0000 7f3600e09700 1 -- 172.21.15.190:0/2582565856 >> v2:172.21.15.78:3300/0 conn(0x7f35fc09f780 msgr2=0x7f35fc148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.942+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> v2:172.21.15.78:3300/0 conn(0x7f35fc09f780 0x7f35fc148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:20.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.942+0000 7f3600e09700 1 -- 172.21.15.190:0/2582565856 >> v1:172.21.15.190:6789/0 conn(0x7f35fc139940 legacy=0x7f35fc12e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:20.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.942+0000 7f3600e09700 1 -- 172.21.15.190:0/2582565856 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc148860 con 0x7f35fc0a73d0 2020-04-02T23:48:20.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.942+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.943+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.943+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:20.949 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.947+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.949 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.947+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec005cc0 con 0x7f35fc0a73d0 2020-04-02T23:48:20.949 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.947+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc136880 con 0x7f35fc0a73d0 2020-04-02T23:48:20.949 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.947+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc1370b0 con 0x7f35fc0a73d0 2020-04-02T23:48:20.950 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.948+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc12ec50 con 0x7f35fc0a73d0 2020-04-02T23:48:20.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.949+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.949+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:20.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.949+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec005e20 con 0x7f35fc0a73d0 2020-04-02T23:48:20.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:20.949+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35ec00a510 con 0x7f35fc0a73d0 2020-04-02T23:48:21.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.127+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.128+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f35ec00a670 con 0x7f35fc0a73d0 2020-04-02T23:48:21.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.128+0000 7f35ea7fc700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:21.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.128+0000 7f360160a700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:21.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.128+0000 7f360160a700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.129+0000 7f360160a700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.129+0000 7f360160a700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:21.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.131+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.131+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f35ec040340 con 0x7f35fc0a73d0 2020-04-02T23:48:21.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.140+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.140+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f35ec03c6e0 con 0x7f35fc0a73d0 2020-04-02T23:48:21.289 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.287+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f35fc056ec0 con 0x7f35fc0a73d0 2020-04-02T23:48:21.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.315+0000 7f3600e09700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.315+0000 7f35ea7fc700 1 -- 172.21.15.190:0/2582565856 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35ec03fd00 con 0x7f35fc0a73d0 2020-04-02T23:48:21.317 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 1 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 msgr2=0x7f35dc04fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f35f8002f30 tx=0x7f35f8007a40).stop 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 msgr2=0x7f35fc137c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f35ec0010d0 tx=0x7f35ec0108f0).stop 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 shutdown_connections 2020-04-02T23:48:21.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f35dc04d950 0x7f35dc04fe60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 --2- 172.21.15.190:0/2582565856 >> v2:172.21.15.78:3300/0 conn(0x7f35fc09f780 0x7f35fc148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 --2- 172.21.15.190:0/2582565856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35fc0a73d0 0x7f35fc137c70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 >> 172.21.15.190:0/2582565856 conn(0x7f35fc05b3d0 msgr2=0x7f35fc130250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:21.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 shutdown_connections 2020-04-02T23:48:21.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.317+0000 7f360386e700 1 -- 172.21.15.190:0/2582565856 wait complete. 2020-04-02T23:48:21.332 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:21.353 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:48:21.501 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.499+0000 7fe1f89f4700 1 Processor -- start 2020-04-02T23:48:21.501 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.499+0000 7fe1f89f4700 1 -- start start 2020-04-02T23:48:21.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f89f4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f40a7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:21.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f89f4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1f40a3160 0x7fe1f40a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:21.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f89f4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f40a75c0 con 0x7fe1f4139630 2020-04-02T23:48:21.502 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f89f4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f4136240 con 0x7fe1f4136c20 2020-04-02T23:48:21.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f89f4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41364e0 con 0x7fe1f40a3160 2020-04-02T23:48:21.503 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.500+0000 7fe1f2d9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f40a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:21.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.501+0000 7fe1f2d9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f40a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60422/0 (socket says 172.21.15.190:60422) 2020-04-02T23:48:21.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.501+0000 7fe1f2d9d700 1 -- 172.21.15.190:0/2259453956 learned_addr learned my addr 172.21.15.190:0/2259453956 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:21.504 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.501+0000 7fe1f359e700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1f40a3160 0x7fe1f40a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:21.505 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.503+0000 7fe1f1d9b700 1 -- 172.21.15.190:0/2259453956 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176611154 0 0) 0x7fe1e80010d0 con 0x7fe1f4139630 2020-04-02T23:48:21.505 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.503+0000 7fe1f1d9b700 1 -- 172.21.15.190:0/2259453956 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d8003230 con 0x7fe1f4139630 2020-04-02T23:48:21.506 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.504+0000 7fe1f2d9d700 1 -- 172.21.15.190:0/2259453956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1f40a3160 msgr2=0x7fe1f40a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:21.506 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.504+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1f40a3160 0x7fe1f40a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:21.506 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.504+0000 7fe1f2d9d700 1 -- 172.21.15.190:0/2259453956 >> v1:172.21.15.78:6789/0 conn(0x7fe1f4139630 legacy=0x7fe1f40a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.506 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.504+0000 7fe1f2d9d700 1 -- 172.21.15.190:0/2259453956 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4136780 con 0x7fe1f4136c20 2020-04-02T23:48:21.507 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.504+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.507 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.506+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.507 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.506+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).ready entity=mon.1 client_cookie=54b516a926f26556 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:21.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f1d9b700 1 -- 172.21.15.190:0/2259453956 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e40115c0 con 0x7fe1f4136c20 2020-04-02T23:48:21.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f1d9b700 1 -- 172.21.15.190:0/2259453956 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4011720 con 0x7fe1f4136c20 2020-04-02T23:48:21.513 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f1d9b700 1 -- 172.21.15.190:0/2259453956 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e4011b40 con 0x7fe1f4136c20 2020-04-02T23:48:21.513 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 -- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 msgr2=0x7fe1f40a7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.513 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe1e4002f30 tx=0x7fe1e4007a40).stop 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 -- 172.21.15.190:0/2259453956 shutdown_connections 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1f40a3160 0x7fe1f40a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/2259453956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f40a7160 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 -- 172.21.15.190:0/2259453956 >> 172.21.15.190:0/2259453956 conn(0x7fe1f4061280 msgr2=0x7fe1f40ab4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 -- 172.21.15.190:0/2259453956 shutdown_connections 2020-04-02T23:48:21.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.510+0000 7fe1f89f4700 1 -- 172.21.15.190:0/2259453956 wait complete. 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.511+0000 7fe1f89f4700 1 Processor -- start 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.512+0000 7fe1f89f4700 1 -- start start 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.512+0000 7fe1f89f4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f4135770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.512+0000 7fe1f89f4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f4138b30 con 0x7fe1f40a3160 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.512+0000 7fe1f89f4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f4138dd0 con 0x7fe1f4139630 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.512+0000 7fe1f89f4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f4139070 con 0x7fe1f4136c20 2020-04-02T23:48:21.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.513+0000 7fe1f259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f4135770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:21.517 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.513+0000 7fe1f2d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1f40a3160 0x7fe1f4137d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36048/0 (socket says 172.21.15.190:36048) 2020-04-02T23:48:21.517 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.513+0000 7fe1f2d9d700 1 -- 172.21.15.190:0/1781870087 learned_addr learned my addr 172.21.15.190:0/1781870087 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:21.517 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.515+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793440244 0 0) 0x7fe1f4138b30 con 0x7fe1f40a3160 2020-04-02T23:48:21.517 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.515+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d0002fe0 con 0x7fe1f40a3160 2020-04-02T23:48:21.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.517+0000 7fe1f259c700 1 -- 172.21.15.190:0/1781870087 >> v1:172.21.15.190:6789/0 conn(0x7fe1f4139630 legacy=0x7fe1f414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.517+0000 7fe1f259c700 1 -- 172.21.15.190:0/1781870087 >> v1:172.21.15.78:6789/0 conn(0x7fe1f40a3160 legacy=0x7fe1f4137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.517+0000 7fe1f259c700 1 -- 172.21.15.190:0/1781870087 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4139310 con 0x7fe1f4136c20 2020-04-02T23:48:21.520 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.518+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.520+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> v2:172.21.15.190:3300/0 conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.520+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:21.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e800cbf0 con 0x7fe1f4136c20 2020-04-02T23:48:21.527 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.528 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800cd50 con 0x7fe1f4136c20 2020-04-02T23:48:21.528 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f412c690 con 0x7fe1f4136c20 2020-04-02T23:48:21.528 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e800e350 con 0x7fe1f4136c20 2020-04-02T23:48:21.528 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.525+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f4134500 con 0x7fe1f4136c20 2020-04-02T23:48:21.528 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.526+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f4056ec0 con 0x7fe1f4136c20 2020-04-02T23:48:21.540 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.538+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.541 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.539+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe1e800e5c0 con 0x7fe1f4136c20 2020-04-02T23:48:21.541 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.539+0000 7fe1e3fff700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:21.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.540+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:21.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.540+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1e40084c0 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.540+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1e40084c0 tx=0x7fe1e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.542 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.540+0000 7fe1f2d9d700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fe1e40084c0 tx=0x7fe1e4007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:21.544 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.542+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.544 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.542+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe1e803ff30 con 0x7fe1f4136c20 2020-04-02T23:48:21.720 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.718+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.720 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.718+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe1e803c270 con 0x7fe1f4136c20 2020-04-02T23:48:21.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.874+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1f40a75c0 con 0x7fe1f4136c20 2020-04-02T23:48:21.894 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.892+0000 7fe1f259c700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:21.894 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.892+0000 7fe1e3fff700 1 -- 172.21.15.190:0/1781870087 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1f40a75c0 con 0x7fe1f4136c20 2020-04-02T23:48:21.894 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:21.896 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.893+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 msgr2=0x7fe1d004fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.896 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.893+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fe1e40084c0 tx=0x7fe1e4007a40).stop 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.893+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 msgr2=0x7fe1f4135770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.893+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fe1e8001260 tx=0x7fe1e8002e70).stop 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 shutdown_connections 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1d004d8d0 0x7fe1d004fde0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 --2- 172.21.15.190:0/1781870087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f4136c20 0x7fe1f4135770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:21.897 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 >> 172.21.15.190:0/1781870087 conn(0x7fe1f4061280 msgr2=0x7fe1f40a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:21.898 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 shutdown_connections 2020-04-02T23:48:21.898 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:21.894+0000 7fe1f89f4700 1 -- 172.21.15.190:0/1781870087 wait complete. 2020-04-02T23:48:21.906 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:21.919 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-02T23:48:22.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.063+0000 7f975564d700 1 Processor -- start 2020-04-02T23:48:22.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.063+0000 7f975564d700 1 -- start start 2020-04-02T23:48:22.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.064+0000 7f975564d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.064+0000 7f975564d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9750141210 0x7f9750141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.064+0000 7f975564d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97500b07b0 con 0x7f97500a7480 2020-04-02T23:48:22.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.064+0000 7f975564d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9750067320 con 0x7f9750141210 2020-04-02T23:48:22.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.064+0000 7f975564d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500af9c0 con 0x7f97500b03a0 2020-04-02T23:48:22.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.065+0000 7f9747fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.065+0000 7f9747fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46292/0 (socket says 172.21.15.190:46292) 2020-04-02T23:48:22.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.065+0000 7f9747fff700 1 -- 172.21.15.190:0/3471739045 learned_addr learned my addr 172.21.15.190:0/3471739045 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:22.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.065+0000 7f9754e4c700 1 --2- 172.21.15.190:0/3471739045 >> v2:172.21.15.78:3300/0 conn(0x7f9750141210 0x7f9750141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.068+0000 7f9747fff700 1 -- 172.21.15.190:0/3471739045 >> v2:172.21.15.78:3300/0 conn(0x7f9750141210 msgr2=0x7f9750141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:22.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.068+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> v2:172.21.15.78:3300/0 conn(0x7f9750141210 0x7f9750141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.068+0000 7f9747fff700 1 -- 172.21.15.190:0/3471739045 >> v1:172.21.15.78:6789/0 conn(0x7f97500a7480 legacy=0x7f97500ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.068+0000 7f9747fff700 1 -- 172.21.15.190:0/3471739045 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500afc60 con 0x7f97500b03a0 2020-04-02T23:48:22.071 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.068+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.070+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.070+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).ready entity=mon.2 client_cookie=5e419728cf511422 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f9747fff700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f974f7fe700 1 -- 172.21.15.190:0/3471739045 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9738011670 con 0x7f97500b03a0 2020-04-02T23:48:22.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f974f7fe700 1 -- 172.21.15.190:0/3471739045 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97380117d0 con 0x7f97500b03a0 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f974f7fe700 1 -- 172.21.15.190:0/3471739045 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9738011bf0 con 0x7f97500b03a0 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f975564d700 1 -- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 msgr2=0x7f9750140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.074+0000 7f975564d700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).stop 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 -- 172.21.15.190:0/3471739045 shutdown_connections 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 --2- 172.21.15.190:0/3471739045 >> v2:172.21.15.78:3300/0 conn(0x7f9750141210 0x7f9750141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 --2- 172.21.15.190:0/3471739045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750140db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 -- 172.21.15.190:0/3471739045 >> 172.21.15.190:0/3471739045 conn(0x7f97500602b0 msgr2=0x7f97500606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:22.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 -- 172.21.15.190:0/3471739045 shutdown_connections 2020-04-02T23:48:22.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.075+0000 7f975564d700 1 -- 172.21.15.190:0/3471739045 wait complete. 2020-04-02T23:48:22.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 Processor -- start 2020-04-02T23:48:22.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 -- start start 2020-04-02T23:48:22.081 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f97500a7480 0x7f975013da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975013a330 con 0x7f9750141210 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975013a5d0 con 0x7f97500a7480 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.076+0000 7f975564d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975013a870 con 0x7f97500b03a0 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.077+0000 7f9754e4c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9750141210 0x7f9750138cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36066/0 (socket says 172.21.15.190:36066) 2020-04-02T23:48:22.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.077+0000 7f9754e4c700 1 -- 172.21.15.190:0/2974403818 learned_addr learned my addr 172.21.15.190:0/2974403818 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:22.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.077+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> v2:172.21.15.190:3300/0 conn(0x7f97500a7480 0x7f975013da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.077+0000 7f9747fff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.080+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004829312 0 0) 0x7f975013a330 con 0x7f9750141210 2020-04-02T23:48:22.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.080+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9734002fe0 con 0x7f9750141210 2020-04-02T23:48:22.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.081+0000 7f974ffff700 1 -- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 msgr2=0x7f9750137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.081+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750137440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.081+0000 7f974ffff700 1 -- 172.21.15.190:0/2974403818 >> v1:172.21.15.78:6789/0 conn(0x7f9750141210 legacy=0x7f9750138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.081+0000 7f974ffff700 1 -- 172.21.15.190:0/2974403818 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750138840 con 0x7f97500a7480 2020-04-02T23:48:22.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.081+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> v2:172.21.15.190:3300/0 conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.085 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.083+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> v2:172.21.15.190:3300/0 conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.085 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.083+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.087+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.087+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.087+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.087+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97400069d0 con 0x7f97500a7480 2020-04-02T23:48:22.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.088+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740006b30 con 0x7f97500a7480 2020-04-02T23:48:22.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.088+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975013b0c0 con 0x7f97500a7480 2020-04-02T23:48:22.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.088+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9740010da0 con 0x7f97500a7480 2020-04-02T23:48:22.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.088+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501395c0 con 0x7f97500a7480 2020-04-02T23:48:22.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.089+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750056ec0 con 0x7f97500a7480 2020-04-02T23:48:22.104 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.102+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.104 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.102+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f974000b290 con 0x7f97500a7480 2020-04-02T23:48:22.105 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.102+0000 7f974dffb700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.105 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.103+0000 7f9747fff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.105 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.103+0000 7f9747fff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.106 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.103+0000 7f9747fff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.106 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.103+0000 7f9747fff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.110 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.108+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.110 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.108+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f974003ff80 con 0x7f97500a7480 2020-04-02T23:48:22.283 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.281+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.283 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.281+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f974003c320 con 0x7f97500a7480 2020-04-02T23:48:22.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.433+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f97500b07b0 con 0x7f97500a7480 2020-04-02T23:48:22.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.438+0000 7f974ffff700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.438+0000 7f974dffb700 1 -- 172.21.15.190:0/2974403818 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+143 (secure 0 0 0) 0x7f97500b07b0 con 0x7f97500a7480 2020-04-02T23:48:22.441 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:22.441 INFO:teuthology.orchestra.run.smithi190.stdout:[ 2020-04-02T23:48:22.441 INFO:teuthology.orchestra.run.smithi190.stdout: { 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: "poolnum": 1, 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: "poolname": "device_health_metrics" 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: { 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: "poolnum": 2, 2020-04-02T23:48:22.442 INFO:teuthology.orchestra.run.smithi190.stdout: "poolname": "rbd" 2020-04-02T23:48:22.443 INFO:teuthology.orchestra.run.smithi190.stdout: } 2020-04-02T23:48:22.443 INFO:teuthology.orchestra.run.smithi190.stdout:] 2020-04-02T23:48:22.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 msgr2=0x7f973404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f9738002f30 tx=0x7f9738007a40).stop 2020-04-02T23:48:22.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 msgr2=0x7f975013da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f97500addb0 tx=0x7f9740010860).stop 2020-04-02T23:48:22.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 shutdown_connections 2020-04-02T23:48:22.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f973404d970 0x7f973404fe80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97500a7480 0x7f975013da10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 --2- 172.21.15.190:0/2974403818 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97500b03a0 0x7f9750137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 >> 172.21.15.190:0/2974403818 conn(0x7f97500602b0 msgr2=0x7f975006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:22.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 shutdown_connections 2020-04-02T23:48:22.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.440+0000 7f975564d700 1 -- 172.21.15.190:0/2974403818 wait complete. 2020-04-02T23:48:22.454 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-02T23:48:22.455 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:22.468 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-02T23:48:22.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 Processor -- start 2020-04-02T23:48:22.618 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 -- start start 2020-04-02T23:48:22.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a07d0 0x7f3cf4137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:22.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40a6180 con 0x7f3cf41378d0 2020-04-02T23:48:22.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf40a0be0 con 0x7f3cf40a07d0 2020-04-02T23:48:22.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.616+0000 7f3cf8c6f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40a63b0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.617+0000 7f3cf1d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a07d0 0x7f3cf4137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.617+0000 7f3cf259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.617+0000 7f3cf259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46304/0 (socket says 172.21.15.190:46304) 2020-04-02T23:48:22.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.617+0000 7f3cf259c700 1 -- 172.21.15.190:0/228412554 learned_addr learned my addr 172.21.15.190:0/228412554 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:22.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.621+0000 7f3cf259c700 1 -- 172.21.15.190:0/228412554 >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a07d0 msgr2=0x7f3cf4137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:22.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.621+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a07d0 0x7f3cf4137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.621+0000 7f3cf259c700 1 -- 172.21.15.190:0/228412554 >> v1:172.21.15.190:6789/0 conn(0x7f3cf41378d0 legacy=0x7f3cf40a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.621+0000 7f3cf259c700 1 -- 172.21.15.190:0/228412554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40a6650 con 0x7f3cf40a4f70 2020-04-02T23:48:22.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.621+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.624 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.622+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.624 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.622+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).ready entity=mon.2 client_cookie=e648bff1cb44520 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf159a700 1 -- 172.21.15.190:0/228412554 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cdc011670 con 0x7f3cf40a4f70 2020-04-02T23:48:22.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf259c700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf159a700 1 -- 172.21.15.190:0/228412554 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc0117d0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf159a700 1 -- 172.21.15.190:0/228412554 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cdc011bf0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 msgr2=0x7f3cf40a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f3cdc002f30 tx=0x7f3cdc007a40).stop 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/228412554 shutdown_connections 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/228412554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3cf40a4f70 0x7f3cf40a0370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/228412554 >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a07d0 0x7f3cf4137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:22.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/228412554 >> 172.21.15.190:0/228412554 conn(0x7f3cf405b3d0 msgr2=0x7f3cf405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:22.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/228412554 shutdown_connections 2020-04-02T23:48:22.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.627+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/228412554 wait complete. 2020-04-02T23:48:22.633 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.628+0000 7f3cf8c6f700 1 Processor -- start 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.628+0000 7f3cf8c6f700 1 -- start start 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf8c6f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a4f70 0x7f3cf40a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf8c6f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3cf41378d0 0x7f3cf40a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf8c6f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf409eaf0 con 0x7f3cf40a07d0 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf8c6f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf409ed90 con 0x7f3cf41378d0 2020-04-02T23:48:22.634 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf8c6f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf409f030 con 0x7f3cf40a4f70 2020-04-02T23:48:22.635 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.629+0000 7f3cf1d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a4f70 0x7f3cf40a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.635 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.630+0000 7f3cf1d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a4f70 0x7f3cf40a2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60456/0 (socket says 172.21.15.190:60456) 2020-04-02T23:48:22.635 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.630+0000 7f3cf1d9b700 1 -- 172.21.15.190:0/3657068243 learned_addr learned my addr 172.21.15.190:0/3657068243 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:22.635 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.630+0000 7f3cf2d9d700 1 --2- 172.21.15.190:0/3657068243 >> v2:172.21.15.78:3300/0 conn(0x7f3cf41378d0 0x7f3cf40a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.633+0000 7f3cf1d9b700 1 -- 172.21.15.190:0/3657068243 >> v2:172.21.15.78:3300/0 conn(0x7f3cf41378d0 msgr2=0x7f3cf40a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.633+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> v2:172.21.15.78:3300/0 conn(0x7f3cf41378d0 0x7f3cf40a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:22.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.633+0000 7f3cf1d9b700 1 -- 172.21.15.190:0/3657068243 >> v1:172.21.15.78:6789/0 conn(0x7f3cf40a07d0 legacy=0x7f3cf40a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:22.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.633+0000 7f3cf1d9b700 1 -- 172.21.15.190:0/3657068243 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40a4930 con 0x7f3cf40a4f70 2020-04-02T23:48:22.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.633+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.635+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> v2:172.21.15.190:3300/0 conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.635+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.642 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.642 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ce4005e90 con 0x7f3cf40a4f70 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40071a0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40a3850 con 0x7f3cf40a4f70 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ce40075c0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.640+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf409e3a0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.644 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.641+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf4056ec0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.659+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.662 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.659+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.662 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.659+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3ce400e420 con 0x7f3cf40a4f70 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3ceb7fe700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3ce4061280 con 0x7f3cf40a4f70 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3cf259c700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3cf259c700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3cf409d9f0 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3cf259c700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3cf409d9f0 tx=0x7f3cdc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.660+0000 7f3cf259c700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f3cf409d9f0 tx=0x7f3cdc007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:22.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.831+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:22.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.831+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f3ce403c9e0 con 0x7f3cf40a4f70 2020-04-02T23:48:22.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:22.973+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3cf405f200 con 0x7f3cf40a4f70 2020-04-02T23:48:23.557 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.555+0000 7f3cf1d9b700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.557 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.555+0000 7f3ceb7fe700 1 -- 172.21.15.190:0/3657068243 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v22) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3ce4040000 con 0x7f3cf40a4f70 2020-04-02T23:48:23.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 msgr2=0x7f3cd804fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f3cf409d9f0 tx=0x7f3cdc007a40).stop 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 msgr2=0x7f3cf40a2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f3ce4002f30 tx=0x7f3ce4010c70).stop 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 shutdown_connections 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f3cd804d5c0 0x7f3cd804fad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/3657068243 >> v2:172.21.15.78:3300/0 conn(0x7f3cf41378d0 0x7f3cf40a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:23.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 --2- 172.21.15.190:0/3657068243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf40a4f70 0x7f3cf40a2f90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:23.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 >> 172.21.15.190:0/3657068243 conn(0x7f3cf405b3d0 msgr2=0x7f3cf4137030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:23.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 shutdown_connections 2020-04-02T23:48:23.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.557+0000 7f3cf8c6f700 1 -- 172.21.15.190:0/3657068243 wait complete. 2020-04-02T23:48:23.561 INFO:teuthology.orchestra.run.smithi190.stderr:pool 'cephfs_metadata' created 2020-04-02T23:48:23.569 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-04-02T23:48:23.570 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:23.592 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-04-02T23:48:23.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.782+0000 7f4a7bca1700 1 Processor -- start 2020-04-02T23:48:23.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.782+0000 7f4a7bca1700 1 -- start start 2020-04-02T23:48:23.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.783+0000 7f4a7bca1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a740a4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:23.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.783+0000 7f4a7bca1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a740a4c50 0x7f4a740a5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:23.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.783+0000 7f4a7bca1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740a7a90 con 0x7f4a740a7070 2020-04-02T23:48:23.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.783+0000 7f4a7bca1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740a3670 con 0x7f4a740a4c50 2020-04-02T23:48:23.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.783+0000 7f4a7bca1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740a77f0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.784+0000 7f4a79a3d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a740a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:23.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.784+0000 7f4a7a23e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a740a4c50 0x7f4a740a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:23.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.784+0000 7f4a7923c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4a740a7070 0x7f4a740a2f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36084/0 (socket says 172.21.15.190:36084) 2020-04-02T23:48:23.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.784+0000 7f4a7923c700 1 -- 172.21.15.190:0/3914770127 learned_addr learned my addr 172.21.15.190:0/3914770127 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:23.789 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.787+0000 7f4a79a3d700 1 -- 172.21.15.190:0/3914770127 >> v2:172.21.15.78:3300/0 conn(0x7f4a740a4c50 msgr2=0x7f4a740a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:23.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.787+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> v2:172.21.15.78:3300/0 conn(0x7f4a740a4c50 0x7f4a740a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:23.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.787+0000 7f4a79a3d700 1 -- 172.21.15.190:0/3914770127 >> v1:172.21.15.78:6789/0 conn(0x7f4a740a7070 legacy=0x7f4a740a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.787+0000 7f4a79a3d700 1 -- 172.21.15.190:0/3914770127 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740a2ac0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.787+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.794 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.789+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.795 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.789+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).ready entity=mon.1 client_cookie=ce28ccddf8a43621 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:23.796 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.796 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.797 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.797 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a78a3b700 1 -- 172.21.15.190:0/3914770127 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c00a160 con 0x7f4a740ac2c0 2020-04-02T23:48:23.797 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a78a3b700 1 -- 172.21.15.190:0/3914770127 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c00a2c0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.797 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.794+0000 7f4a78a3b700 1 -- 172.21.15.190:0/3914770127 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c00a6a0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 -- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 msgr2=0x7f4a740a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).stop 2020-04-02T23:48:23.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 -- 172.21.15.190:0/3914770127 shutdown_connections 2020-04-02T23:48:23.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/3914770127 >> v2:172.21.15.78:3300/0 conn(0x7f4a740a4c50 0x7f4a740a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:23.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/3914770127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a740a4740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:23.799 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 -- 172.21.15.190:0/3914770127 >> 172.21.15.190:0/3914770127 conn(0x7f4a7405b3d0 msgr2=0x7f4a7405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:23.799 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 -- 172.21.15.190:0/3914770127 shutdown_connections 2020-04-02T23:48:23.799 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.795+0000 7f4a7bca1700 1 -- 172.21.15.190:0/3914770127 wait complete. 2020-04-02T23:48:23.800 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.796+0000 7f4a7bca1700 1 Processor -- start 2020-04-02T23:48:23.800 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.796+0000 7f4a7bca1700 1 -- start start 2020-04-02T23:48:23.800 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.797+0000 7f4a7bca1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a740a4c50 0x7f4a74065b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.797+0000 7f4a7bca1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a74061c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.797+0000 7f4a7bca1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a74066510 con 0x7f4a740a7070 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.797+0000 7f4a7bca1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a741462f0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.797+0000 7f4a7bca1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74146590 con 0x7f4a740a4c50 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.798+0000 7f4a7923c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4a740a7070 0x7f4a74134f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36090/0 (socket says 172.21.15.190:36090) 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.798+0000 7f4a7923c700 1 -- 172.21.15.190:0/233871408 learned_addr learned my addr 172.21.15.190:0/233871408 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:23.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.798+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a74061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:23.802 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.798+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a740a4c50 0x7f4a74065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:23.803 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.801+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139327575 0 0) 0x7f4a74066510 con 0x7f4a740a7070 2020-04-02T23:48:23.803 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.801+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a54002fe0 con 0x7f4a740a7070 2020-04-02T23:48:23.805 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.803+0000 7f4a7a23e700 1 -- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a740a4c50 msgr2=0x7f4a74065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.803+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a740a4c50 0x7f4a74065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:23.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.803+0000 7f4a7a23e700 1 -- 172.21.15.190:0/233871408 >> v1:172.21.15.78:6789/0 conn(0x7f4a740a7070 legacy=0x7f4a74134f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:23.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.803+0000 7f4a7a23e700 1 -- 172.21.15.190:0/233871408 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74146830 con 0x7f4a740ac2c0 2020-04-02T23:48:23.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.804+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.809 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.807+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> v2:172.21.15.190:3300/0 conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.809 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.807+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:23.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.810+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.810+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64007530 con 0x7f4a740ac2c0 2020-04-02T23:48:23.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.810+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74066020 con 0x7f4a740ac2c0 2020-04-02T23:48:23.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.810+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740a1190 con 0x7f4a740ac2c0 2020-04-02T23:48:23.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.811+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74066330 con 0x7f4a740ac2c0 2020-04-02T23:48:23.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.811+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.814 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.811+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:23.814 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.811+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640056c0 con 0x7f4a740ac2c0 2020-04-02T23:48:23.814 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:23.811+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64005a60 con 0x7f4a740ac2c0 2020-04-02T23:48:24.007 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.005+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4a64005bc0 con 0x7f4a740ac2c0 2020-04-02T23:48:24.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a62ffd700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:24.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f4a6400d0c0 con 0x7f4a740ac2c0 2020-04-02T23:48:24.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4a64061320 con 0x7f4a740ac2c0 2020-04-02T23:48:24.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.006+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:24.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.007+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.007+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.007+0000 7f4a79a3d700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:24.180 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.178+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4a741469c0 con 0x7f4a740ac2c0 2020-04-02T23:48:24.593 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.592+0000 7f4a7a23e700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.594 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.592+0000 7f4a62ffd700 1 -- 172.21.15.190:0/233871408 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 154+0+0 (secure 0 0 0) 0x7f4a6403ff50 con 0x7f4a740ac2c0 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 msgr2=0x7f4a5404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f4a6c0032b0 tx=0x7f4a6c007dc0).stop 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 msgr2=0x7f4a74061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f4a64002f30 tx=0x7f4a64010b40).stop 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 shutdown_connections 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f4a5404d8f0 0x7f4a5404fe00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a740ac2c0 0x7f4a74061c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.598 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 --2- 172.21.15.190:0/233871408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a740a4c50 0x7f4a74065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.598 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.594+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 >> 172.21.15.190:0/233871408 conn(0x7f4a7405b3d0 msgr2=0x7f4a7406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:24.598 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.595+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 shutdown_connections 2020-04-02T23:48:24.598 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.595+0000 7f4a7bca1700 1 -- 172.21.15.190:0/233871408 wait complete. 2020-04-02T23:48:24.607 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:24.630 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-04-02T23:48:24.817 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.815+0000 7f8bf566a700 1 Processor -- start 2020-04-02T23:48:24.818 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.815+0000 7f8bf566a700 1 -- start start 2020-04-02T23:48:24.818 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.816+0000 7f8bf566a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bf00667a0 0x7f8bf0132d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:24.818 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.816+0000 7f8bf566a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf0139510 con 0x7f8bf00a7430 2020-04-02T23:48:24.819 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.816+0000 7f8bf566a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf00670e0 con 0x7f8bf01331a0 2020-04-02T23:48:24.819 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.816+0000 7f8bf566a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf0066bb0 con 0x7f8bf00667a0 2020-04-02T23:48:24.819 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.817+0000 7f8be7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bf00667a0 0x7f8bf0132d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:24.819 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.817+0000 7f8bf4e69700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f8bf01331a0 0x7f8bf01335b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53700/0 (socket says 172.21.15.190:53700) 2020-04-02T23:48:24.820 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.817+0000 7f8bf4e69700 1 -- 172.21.15.190:0/2138702886 learned_addr learned my addr 172.21.15.190:0/2138702886 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:24.823 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.820+0000 7f8be7fff700 1 -- 172.21.15.190:0/2138702886 >> v1:172.21.15.190:6789/0 conn(0x7f8bf01331a0 legacy=0x7f8bf01335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.823 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.821+0000 7f8be7fff700 1 -- 172.21.15.190:0/2138702886 >> v1:172.21.15.78:6789/0 conn(0x7f8bf00a7430 legacy=0x7f8bf0139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.821+0000 7f8be7fff700 1 -- 172.21.15.190:0/2138702886 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0066e40 con 0x7f8bf00667a0 2020-04-02T23:48:24.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.821+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> v2:172.21.15.78:3300/0 conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8be0002f30 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.826 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.825+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> v2:172.21.15.78:3300/0 conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8be0002f30 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.825+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8bf005c560).ready entity=mon.0 client_cookie=59477aefe293bb8d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:24.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8be7fff700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8bef7fe700 1 -- 172.21.15.190:0/2138702886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be0011470 con 0x7f8bf00667a0 2020-04-02T23:48:24.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8bef7fe700 1 -- 172.21.15.190:0/2138702886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be00115d0 con 0x7f8bf00667a0 2020-04-02T23:48:24.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8bef7fe700 1 -- 172.21.15.190:0/2138702886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be0011970 con 0x7f8bf00667a0 2020-04-02T23:48:24.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8bf566a700 1 -- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 msgr2=0x7f8bf0132d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.832+0000 7f8bf566a700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8bf005c560).stop 2020-04-02T23:48:24.838 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.833+0000 7f8bf566a700 1 -- 172.21.15.190:0/2138702886 shutdown_connections 2020-04-02T23:48:24.838 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.833+0000 7f8bf566a700 1 --2- 172.21.15.190:0/2138702886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00667a0 0x7f8bf0132d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.833+0000 7f8bf566a700 1 -- 172.21.15.190:0/2138702886 >> 172.21.15.190:0/2138702886 conn(0x7f8bf0065a20 msgr2=0x7f8bf0060200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.834+0000 7f8bf566a700 1 -- 172.21.15.190:0/2138702886 shutdown_connections 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.834+0000 7f8bf566a700 1 -- 172.21.15.190:0/2138702886 wait complete. 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.835+0000 7f8bf566a700 1 Processor -- start 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.835+0000 7f8bf566a700 1 -- start start 2020-04-02T23:48:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8bf566a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bf00667a0 0x7f8bf0137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:24.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8bf566a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8bf00a7430 0x7f8bf00a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:24.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8bf566a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf00a8ed0 con 0x7f8bf01331a0 2020-04-02T23:48:24.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8bf566a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf00a9170 con 0x7f8bf00a7430 2020-04-02T23:48:24.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8bf566a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00a9410 con 0x7f8bf00667a0 2020-04-02T23:48:24.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.836+0000 7f8be7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8bf00a7430 0x7f8bf00a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:24.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.837+0000 7f8be7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8bf00a7430 0x7f8bf00a7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60482/0 (socket says 172.21.15.190:60482) 2020-04-02T23:48:24.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.837+0000 7f8be7fff700 1 -- 172.21.15.190:0/1598300736 learned_addr learned my addr 172.21.15.190:0/1598300736 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:24.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.837+0000 7f8beffff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bf00667a0 0x7f8bf0137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:24.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.840+0000 7f8be7fff700 1 -- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bf00667a0 msgr2=0x7f8bf0137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.843 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.840+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bf00667a0 0x7f8bf0137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:24.843 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.840+0000 7f8be7fff700 1 -- 172.21.15.190:0/1598300736 >> v1:172.21.15.190:6789/0 conn(0x7f8bf01331a0 legacy=0x7f8bf01471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:24.843 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.840+0000 7f8be7fff700 1 -- 172.21.15.190:0/1598300736 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00a96b0 con 0x7f8bf00a7430 2020-04-02T23:48:24.843 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.841+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.846 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.844+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> v2:172.21.15.190:3300/0 conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.846 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.844+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:24.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.853+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.853+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.853+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:24.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.853+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be0011e90 con 0x7f8bf00a7430 2020-04-02T23:48:24.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.854+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0007150 con 0x7f8bf00a7430 2020-04-02T23:48:24.857 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.854+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8be0007570 con 0x7f8bf00a7430 2020-04-02T23:48:24.857 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.854+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf00a8c30 con 0x7f8bf00a7430 2020-04-02T23:48:24.857 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.854+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf0146ac0 con 0x7f8bf00a7430 2020-04-02T23:48:24.858 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:24.856+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf0056ec0 con 0x7f8bf00a7430 2020-04-02T23:48:25.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.075+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:25.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8be00056c0 con 0x7f8bf00a7430 2020-04-02T23:48:25.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:25.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:25.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8bedffb700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:25.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f8be0061810 con 0x7f8bf00a7430 2020-04-02T23:48:25.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8be0061b30 con 0x7f8bf00a7430 2020-04-02T23:48:25.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8beffff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:25.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8beffff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf00a6dc0 tx=0x7f8bd8003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:25.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8beffff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf00a6dc0 tx=0x7f8bd8003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:25.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.076+0000 7f8beffff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f8bf00a6dc0 tx=0x7f8bd8003e20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:25.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.219+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f8bf0138690 con 0x7f8bf00a7430 2020-04-02T23:48:25.838 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:25.836+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:26.914 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.912+0000 7f8be7fff700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:26.914 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.912+0000 7f8bedffb700 1 -- 172.21.15.190:0/1598300736 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v25) v1 ==== 188+0+0 (secure 0 0 0) 0x7f8be00407d0 con 0x7f8bf00a7430 2020-04-02T23:48:26.916 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 msgr2=0x7f8bd404fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:26.916 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f8bf00a6dc0 tx=0x7f8bd8003e20).stop 2020-04-02T23:48:26.916 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 msgr2=0x7f8bf00a7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:26.916 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f8bf013c720 tx=0x7f8bf005c560).stop 2020-04-02T23:48:26.916 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 shutdown_connections 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f8bd404d560 0x7f8bd404fa70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8bf00667a0 0x7f8bf0137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 --2- 172.21.15.190:0/1598300736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8bf00a7430 0x7f8bf00a7d10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 >> 172.21.15.190:0/1598300736 conn(0x7f8bf0065a20 msgr2=0x7f8bf006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 shutdown_connections 2020-04-02T23:48:26.917 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:26.913+0000 7f8bf566a700 1 -- 172.21.15.190:0/1598300736 wait complete. 2020-04-02T23:48:26.918 INFO:teuthology.orchestra.run.smithi190.stderr:pool 'cephfs_data' created 2020-04-02T23:48:26.927 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:26.941 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-04-02T23:48:27.128 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 Processor -- start 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 -- start start 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe7d4136670 0x7fe7d4136a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40a34b0 con 0x7fe7d40a7320 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40a3210 con 0x7fe7d4136670 2020-04-02T23:48:27.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.126+0000 7fe7d95c8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40a3f70 con 0x7fe7d40a39a0 2020-04-02T23:48:27.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.127+0000 7fe7d37fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe7d40a7320 0x7fe7d40a4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53714/0 (socket says 172.21.15.190:53714) 2020-04-02T23:48:27.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.127+0000 7fe7d37fe700 1 -- 172.21.15.190:0/184984021 learned_addr learned my addr 172.21.15.190:0/184984021 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:27.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.127+0000 7fe7d8dc7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe7d4136670 0x7fe7d4136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:27.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.127+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:27.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d2ffd700 1 -- 172.21.15.190:0/184984021 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220316499 0 0) 0x7fe7d40a34b0 con 0x7fe7d40a7320 2020-04-02T23:48:27.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d2ffd700 1 -- 172.21.15.190:0/184984021 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c0003230 con 0x7fe7d40a7320 2020-04-02T23:48:27.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d8dc7700 1 -- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 msgr2=0x7fe7d40a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:27.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d40a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:27.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d8dc7700 1 -- 172.21.15.190:0/184984021 >> v1:172.21.15.190:6789/0 conn(0x7fe7d40a7320 legacy=0x7fe7d40a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:27.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.130+0000 7fe7d8dc7700 1 -- 172.21.15.190:0/184984021 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40a4b20 con 0x7fe7d4136670 2020-04-02T23:48:27.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.131+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> v2:172.21.15.78:3300/0 conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.134 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.132+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> v2:172.21.15.78:3300/0 conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.134 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.132+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).ready entity=mon.0 client_cookie=71f61d4be224191c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:27.140 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d2ffd700 1 -- 172.21.15.190:0/184984021 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc011d70 con 0x7fe7d4136670 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d2ffd700 1 -- 172.21.15.190:0/184984021 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00a160 con 0x7fe7d4136670 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d2ffd700 1 -- 172.21.15.190:0/184984021 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc00a580 con 0x7fe7d4136670 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d95c8700 1 -- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 msgr2=0x7fe7d4136a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:27.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.136+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc007dc0).stop 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 -- 172.21.15.190:0/184984021 shutdown_connections 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d40a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/184984021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d4136670 0x7fe7d4136a80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 -- 172.21.15.190:0/184984021 >> 172.21.15.190:0/184984021 conn(0x7fe7d4061280 msgr2=0x7fe7d40ab4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 -- 172.21.15.190:0/184984021 shutdown_connections 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.137+0000 7fe7d95c8700 1 -- 172.21.15.190:0/184984021 wait complete. 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.138+0000 7fe7d95c8700 1 Processor -- start 2020-04-02T23:48:27.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.138+0000 7fe7d95c8700 1 -- start start 2020-04-02T23:48:27.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d95c8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d95c8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe7d4136670 0x7fe7d40663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d95c8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40651c0 con 0x7fe7d40a7320 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d95c8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d4065f00 con 0x7fe7d4136670 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d95c8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40a66c0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe7d40a7320 0x7fe7d4064790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36116/0 (socket says 172.21.15.190:36116) 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d37fe700 1 -- 172.21.15.190:0/1024305149 learned_addr learned my addr 172.21.15.190:0/1024305149 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:27.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.139+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:27.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.140+0000 7fe7d8dc7700 1 --2- 172.21.15.190:0/1024305149 >> v2:172.21.15.190:3300/0 conn(0x7fe7d4136670 0x7fe7d40663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:27.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.142+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689056875 0 0) 0x7fe7d40651c0 con 0x7fe7d40a7320 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.142+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b4002fe0 con 0x7fe7d40a7320 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.143+0000 7fe7d3fff700 1 -- 172.21.15.190:0/1024305149 >> v2:172.21.15.190:3300/0 conn(0x7fe7d4136670 msgr2=0x7fe7d40663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.143+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> v2:172.21.15.190:3300/0 conn(0x7fe7d4136670 0x7fe7d40663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.143+0000 7fe7d3fff700 1 -- 172.21.15.190:0/1024305149 >> v1:172.21.15.78:6789/0 conn(0x7fe7d40a7320 legacy=0x7fe7d4064790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.143+0000 7fe7d3fff700 1 -- 172.21.15.190:0/1024305149 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4066800 con 0x7fe7d40a39a0 2020-04-02T23:48:27.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.144+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.148 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.146+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.148 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.146+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:27.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7c8007530 con 0x7fe7d40a39a0 2020-04-02T23:48:27.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c80056c0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7c8005ae0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d4064ea0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.150+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d4067a40 con 0x7fe7d40a39a0 2020-04-02T23:48:27.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.151+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d4065d60 con 0x7fe7d40a39a0 2020-04-02T23:48:27.166 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.164+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe7c8005d50 con 0x7fe7d40a39a0 2020-04-02T23:48:27.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d17fa700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:27.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d37fe700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:27.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d37fe700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7c4000ef0 tx=0x7fe7c4001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d37fe700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7c4000ef0 tx=0x7fe7c4001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.165+0000 7fe7d37fe700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fe7c4000ef0 tx=0x7fe7c4001720).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:27.202 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.200+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.202 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.200+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fe7c800d0c0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.347 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.345+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:27.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.345+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe7c803c5c0 con 0x7fe7d40a39a0 2020-04-02T23:48:27.486 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:27.484+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe7d4065d60 con 0x7fe7d40a39a0 2020-04-02T23:48:28.033 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.028+0000 7fe7d3fff700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.033 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.028+0000 7fe7d17fa700 1 -- 172.21.15.190:0/1024305149 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe7d4065d60 con 0x7fe7d40a39a0 2020-04-02T23:48:28.041 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 msgr2=0x7fe7b404fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.041 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fe7c4000ef0 tx=0x7fe7c4001720).stop 2020-04-02T23:48:28.041 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 msgr2=0x7fe7d414a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fe7c8002f30 tx=0x7fe7c8010bb0).stop 2020-04-02T23:48:28.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 shutdown_connections 2020-04-02T23:48:28.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe7b404d930 0x7fe7b404fe40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/1024305149 >> v2:172.21.15.190:3300/0 conn(0x7fe7d4136670 0x7fe7d40663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 --2- 172.21.15.190:0/1024305149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7d40a39a0 0x7fe7d414a000 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 >> 172.21.15.190:0/1024305149 conn(0x7fe7d4061280 msgr2=0x7fe7d40a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:28.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 shutdown_connections 2020-04-02T23:48:28.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.033+0000 7fe7d95c8700 1 -- 172.21.15.190:0/1024305149 wait complete. 2020-04-02T23:48:28.043 INFO:teuthology.orchestra.run.smithi190.stderr:set pool 4 allow_ec_overwrites to true 2020-04-02T23:48:28.048 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:28.066 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-02T23:48:28.260 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.249+0000 7f6ce4546700 1 Processor -- start 2020-04-02T23:48:28.260 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.249+0000 7f6ce4546700 1 -- start start 2020-04-02T23:48:28.260 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.250+0000 7f6ce4546700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 0x7f6cdc0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:28.260 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.250+0000 7f6ce4546700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:28.260 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.250+0000 7f6ce4546700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0a2c20 con 0x7f6cdc136390 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.250+0000 7f6ce4546700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a4b90 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.250+0000 7f6ce4546700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a2e50 con 0x7f6cdc09f780 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.251+0000 7f6ce1ae1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.251+0000 7f6ce22e2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 0x7f6cdc0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.251+0000 7f6ce22e2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 0x7f6cdc0a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51372/0 (socket says 172.21.15.190:51372) 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.251+0000 7f6ce22e2700 1 -- 172.21.15.190:0/1268429071 learned_addr learned my addr 172.21.15.190:0/1268429071 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:28.261 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.254+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1268429071 >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 msgr2=0x7f6cdc0a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.254+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 0x7f6cdc0a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.254+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1268429071 >> v1:172.21.15.78:6789/0 conn(0x7f6cdc136390 legacy=0x7f6cdc1367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.254+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1268429071 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0a47c0 con 0x7f6cdc09f780 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.255+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.256+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.262 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.256+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).ready entity=mon.2 client_cookie=7f5ad65dcbf5dc0d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:28.263 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.259+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.263 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.259+0000 7f6ce12e0700 1 -- 172.21.15.190:0/1268429071 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc0113c0 con 0x7f6cdc09f780 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce12e0700 1 -- 172.21.15.190:0/1268429071 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc011520 con 0x7f6cdc09f780 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce12e0700 1 -- 172.21.15.190:0/1268429071 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc011900 con 0x7f6cdc09f780 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce4546700 1 -- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 msgr2=0x7f6cdc0a32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.261+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).stop 2020-04-02T23:48:28.271 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 -- 172.21.15.190:0/1268429071 shutdown_connections 2020-04-02T23:48:28.271 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1268429071 >> v2:172.21.15.78:3300/0 conn(0x7f6cdc0a73d0 0x7f6cdc0a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:28.271 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1268429071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc09f780 0x7f6cdc0a32f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.271 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 -- 172.21.15.190:0/1268429071 >> 172.21.15.190:0/1268429071 conn(0x7f6cdc05b3d0 msgr2=0x7f6cdc05b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:28.271 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 -- 172.21.15.190:0/1268429071 shutdown_connections 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.262+0000 7f6ce4546700 1 -- 172.21.15.190:0/1268429071 wait complete. 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 Processor -- start 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 -- start start 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0aabc0 con 0x7f6cdc09f780 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0aae60 con 0x7f6cdc136390 2020-04-02T23:48:28.272 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.263+0000 7f6ce4546700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0a9b70 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.264+0000 7f6ce1ae1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.264+0000 7f6ce22e2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6cdc09f780 0x7f6cdc0a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36128/0 (socket says 172.21.15.190:36128) 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.264+0000 7f6ce22e2700 1 -- 172.21.15.190:0/1256845778 learned_addr learned my addr 172.21.15.190:0/1256845778 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.267+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523993881 0 0) 0x7f6cdc0aae60 con 0x7f6cdc136390 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.267+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cbc002fe0 con 0x7f6cdc136390 2020-04-02T23:48:28.277 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.267+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213921400 0 0) 0x7f6cdc0aabc0 con 0x7f6cdc09f780 2020-04-02T23:48:28.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.267+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc0aae60 con 0x7f6cdc09f780 2020-04-02T23:48:28.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.269+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1256845778 >> v1:172.21.15.190:6789/0 conn(0x7f6cdc136390 legacy=0x7f6cdc1483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.269+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1256845778 >> v1:172.21.15.78:6789/0 conn(0x7f6cdc09f780 legacy=0x7f6cdc0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.278 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.269+0000 7f6ce1ae1700 1 -- 172.21.15.190:0/1256845778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0954a0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.279 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.269+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.279 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.272+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.279 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.272+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.276+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.276+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.276+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.276+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc0117c0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.277+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc011920 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.277+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc1276e0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.280 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.277+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ccc007340 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.281 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.277+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc0aa960 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.281 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.278+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc095630 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.292 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.291+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.293 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.291+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6ccc0056c0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.293 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.291+0000 7f6ccb7fe700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:28.294 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.292+0000 7f6ce22e2700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:28.294 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.292+0000 7f6ce22e2700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6cd8002f30 tx=0x7f6cd80090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.294 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.292+0000 7f6ce22e2700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6cd8002f30 tx=0x7f6cd80090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.294 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.292+0000 7f6ce22e2700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f6cd8002f30 tx=0x7f6cd80090b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:28.295 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.293+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.295 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.293+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f6ccc040b10 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.493 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.491+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.493 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.491+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f6ccc03ceb0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.720 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.718+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6cdc056ec0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.842 INFO:tasks.ceph.mon.b.smithi078.stderr:2020-04-02T23:48:28.821+0000 1fb62700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-02T23:48:28.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.975+0000 7f6ce1ae1700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:28.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.975+0000 7f6ccb7fe700 1 -- 172.21.15.190:0/1256845778 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f6ccc0404d0 con 0x7f6cdc0a73d0 2020-04-02T23:48:28.979 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 msgr2=0x7f6cbc04ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.979 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f6cd8002f30 tx=0x7f6cd80090b0).stop 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 msgr2=0x7f6cdc095940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6ccc002f30 tx=0x7f6ccc007a40).stop 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 shutdown_connections 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f6cbc04da10 0x7f6cbc04ff20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 --2- 172.21.15.190:0/1256845778 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cdc0a73d0 0x7f6cdc095940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:28.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 >> 172.21.15.190:0/1256845778 conn(0x7f6cdc05b3d0 msgr2=0x7f6cdc0a5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:28.981 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 shutdown_connections 2020-04-02T23:48:28.981 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:28.977+0000 7f6ce4546700 1 -- 172.21.15.190:0/1256845778 wait complete. 2020-04-02T23:48:28.981 INFO:teuthology.orchestra.run.smithi190.stderr:new fs with metadata pool 3 and data pool 4 2020-04-02T23:48:28.992 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:29.005 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:29.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.174+0000 7f1818bf2700 1 Processor -- start 2020-04-02T23:48:29.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.174+0000 7f1818bf2700 1 -- start start 2020-04-02T23:48:29.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.175+0000 7f1818bf2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:29.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.175+0000 7f1818bf2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1814139c00 0x7f181413a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:29.178 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.175+0000 7f1818bf2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18140a0130 con 0x7f18140ab680 2020-04-02T23:48:29.178 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.175+0000 7f1818bf2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140a8220 con 0x7f1814139c00 2020-04-02T23:48:29.178 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.175+0000 7f1818bf2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181409f980 con 0x7f18140a7c30 2020-04-02T23:48:29.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.180+0000 7f181259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.180+0000 7f181259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46370/0 (socket says 172.21.15.190:46370) 2020-04-02T23:48:29.183 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.180+0000 7f181259c700 1 -- 172.21.15.190:0/3218366442 learned_addr learned my addr 172.21.15.190:0/3218366442 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:29.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.183+0000 7f180bfff700 1 --2- 172.21.15.190:0/3218366442 >> v2:172.21.15.190:3300/0 conn(0x7f1814139c00 0x7f181413a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.185 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.184+0000 7f181259c700 1 -- 172.21.15.190:0/3218366442 >> v2:172.21.15.190:3300/0 conn(0x7f1814139c00 msgr2=0x7f181413a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:29.186 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.184+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> v2:172.21.15.190:3300/0 conn(0x7f1814139c00 0x7f181413a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:29.186 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.184+0000 7f181259c700 1 -- 172.21.15.190:0/3218366442 >> v1:172.21.15.190:6789/0 conn(0x7f18140ab680 legacy=0x7f18140aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.186 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.184+0000 7f181259c700 1 -- 172.21.15.190:0/3218366442 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181409fbf0 con 0x7f18140a7c30 2020-04-02T23:48:29.186 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.184+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1804002f30 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.186+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1804002f30 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.188 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.186+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f1804002f30 tx=0x7f1804007a40).ready entity=mon.2 client_cookie=a77c6c77957b3a08 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.190 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.189+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1804002f30 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.191 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.189+0000 7f1811d9b700 1 -- 172.21.15.190:0/3218366442 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804011720 con 0x7f18140a7c30 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.190+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1804002f30 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f181259c700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f1804002f30 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1811d9b700 1 -- 172.21.15.190:0/3218366442 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804011880 con 0x7f18140a7c30 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1811d9b700 1 -- 172.21.15.190:0/3218366442 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804011ca0 con 0x7f18140a7c30 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 -- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 msgr2=0x7f181409f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f1804002f30 tx=0x7f1804007a40).stop 2020-04-02T23:48:29.194 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 -- 172.21.15.190:0/3218366442 shutdown_connections 2020-04-02T23:48:29.194 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 --2- 172.21.15.190:0/3218366442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f18140a7c30 0x7f181409f520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.194 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 --2- 172.21.15.190:0/3218366442 >> v2:172.21.15.190:3300/0 conn(0x7f1814139c00 0x7f181413a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:29.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 -- 172.21.15.190:0/3218366442 >> 172.21.15.190:0/3218366442 conn(0x7f181406b360 msgr2=0x7f18140612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:29.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 -- 172.21.15.190:0/3218366442 shutdown_connections 2020-04-02T23:48:29.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.191+0000 7f1818bf2700 1 -- 172.21.15.190:0/3218366442 wait complete. 2020-04-02T23:48:29.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.192+0000 7f1818bf2700 1 Processor -- start 2020-04-02T23:48:29.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.192+0000 7f1818bf2700 1 -- start start 2020-04-02T23:48:29.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1818bf2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f18140ab680 0x7f18141350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:29.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1818bf2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1814139c00 0x7f181412ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1818bf2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181412fab0 con 0x7f18140a7c30 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1818bf2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181412fd50 con 0x7f1814139c00 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1818bf2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1814136000 con 0x7f18140ab680 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f180bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f18140ab680 0x7f18141350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1812d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1814139c00 0x7f181412ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1812d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1814139c00 0x7f181412ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51394/0 (socket says 172.21.15.190:51394) 2020-04-02T23:48:29.197 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.193+0000 7f1812d9d700 1 -- 172.21.15.190:0/2324171626 learned_addr learned my addr 172.21.15.190:0/2324171626 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:29.199 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.197+0000 7f1812d9d700 1 -- 172.21.15.190:0/2324171626 >> v2:172.21.15.190:3300/0 conn(0x7f18140ab680 msgr2=0x7f18141350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.199 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.197+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> v2:172.21.15.190:3300/0 conn(0x7f18140ab680 0x7f18141350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.200 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.197+0000 7f1812d9d700 1 -- 172.21.15.190:0/2324171626 >> v1:172.21.15.190:6789/0 conn(0x7f18140a7c30 legacy=0x7f1814148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.200 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.197+0000 7f1812d9d700 1 -- 172.21.15.190:0/2324171626 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814136170 con 0x7f1814139c00 2020-04-02T23:48:29.200 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.198+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> v2:172.21.15.78:3300/0 conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.201 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.200+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> v2:172.21.15.78:3300/0 conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.202 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.200+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.206 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.206 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.206 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.206 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180c0101c0 con 0x7f1814139c00 2020-04-02T23:48:29.207 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c010360 con 0x7f1814139c00 2020-04-02T23:48:29.207 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18141301f0 con 0x7f1814139c00 2020-04-02T23:48:29.207 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180c010780 con 0x7f1814139c00 2020-04-02T23:48:29.207 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.204+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814135770 con 0x7f1814139c00 2020-04-02T23:48:29.207 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.205+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1814056ec0 con 0x7f1814139c00 2020-04-02T23:48:29.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.220+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.222 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.220+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f180c006860 con 0x7f1814139c00 2020-04-02T23:48:29.222 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.220+0000 7f180b7fe700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:29.223 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.220+0000 7f181259c700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.223 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.221+0000 7f181259c700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1814134fe0 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.223 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.221+0000 7f181259c700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1814134fe0 tx=0x7f1804007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.223 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.221+0000 7f181259c700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1814134fe0 tx=0x7f1804007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.224 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.222+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.224 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.222+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f180c0406b0 con 0x7f1814139c00 2020-04-02T23:48:29.395 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.393+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.395 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.393+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f180c03ca50 con 0x7f1814139c00 2020-04-02T23:48:29.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.536+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f181405c3e0 con 0x7f1814139c00 2020-04-02T23:48:29.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.570+0000 7f1812d9d700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.570+0000 7f180b7fe700 1 -- 172.21.15.190:0/2324171626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f180c040070 con 0x7f1814139c00 2020-04-02T23:48:29.572 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:29.573 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 msgr2=0x7f17f804fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f1814134fe0 tx=0x7f1804007a40).stop 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 msgr2=0x7f181412ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f18140a90c0 tx=0x7f180c010c60).stop 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 shutdown_connections 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f17f804d650 0x7f17f804fb60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.574 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 --2- 172.21.15.190:0/2324171626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1814139c00 0x7f181412ea80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.575 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 --2- 172.21.15.190:0/2324171626 >> v2:172.21.15.190:3300/0 conn(0x7f18140ab680 0x7f18141350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.575 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 >> 172.21.15.190:0/2324171626 conn(0x7f181406b360 msgr2=0x7f1814136e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:29.575 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 shutdown_connections 2020-04-02T23:48:29.575 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.571+0000 7f1818bf2700 1 -- 172.21.15.190:0/2324171626 wait complete. 2020-04-02T23:48:29.585 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:29.598 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:29.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.744+0000 7fe1d1422700 1 Processor -- start 2020-04-02T23:48:29.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.744+0000 7fe1d1422700 1 -- start start 2020-04-02T23:48:29.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.745+0000 7fe1d1422700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:29.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.745+0000 7fe1d1422700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1cc136a10 0x7fe1cc136e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:29.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.745+0000 7fe1d1422700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0a89d0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.745+0000 7fe1d1422700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc09fb40 con 0x7fe1cc136a10 2020-04-02T23:48:29.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.745+0000 7fe1d1422700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc09fde0 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.746+0000 7fe1ca7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.746+0000 7fe1caffd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe1cc0a7bc0 0x7fe1cc0a0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53748/0 (socket says 172.21.15.190:53748) 2020-04-02T23:48:29.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.746+0000 7fe1caffd700 1 -- 172.21.15.190:0/1274170948 learned_addr learned my addr 172.21.15.190:0/1274170948 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:29.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.746+0000 7fe1cb7fe700 1 --2- 172.21.15.190:0/1274170948 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc136a10 0x7fe1cc136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1c9ffb700 1 -- 172.21.15.190:0/1274170948 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995657344 0 0) 0x7fe1cc0a89d0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1c9ffb700 1 -- 172.21.15.190:0/1274170948 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac003230 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/1274170948 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc136a10 msgr2=0x7fe1cc136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc136a10 0x7fe1cc136e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/1274170948 >> v1:172.21.15.190:6789/0 conn(0x7fe1cc0a7bc0 legacy=0x7fe1cc0a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.749+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/1274170948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0a0080 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.750+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.753 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.751+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.753 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.751+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).ready entity=mon.2 client_cookie=77b998da14df8011 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1c9ffb700 1 -- 172.21.15.190:0/1274170948 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b40113c0 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1c9ffb700 1 -- 172.21.15.190:0/1274170948 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4011520 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.759 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1c9ffb700 1 -- 172.21.15.190:0/1274170948 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b4011940 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.759 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 -- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 msgr2=0x7fe1cc0a82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.759 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe1b4002f30 tx=0x7fe1b4007a40).stop 2020-04-02T23:48:29.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 -- 172.21.15.190:0/1274170948 shutdown_connections 2020-04-02T23:48:29.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 --2- 172.21.15.190:0/1274170948 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc136a10 0x7fe1cc136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:29.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 --2- 172.21.15.190:0/1274170948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1cc0a16d0 0x7fe1cc0a82f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:29.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 -- 172.21.15.190:0/1274170948 >> 172.21.15.190:0/1274170948 conn(0x7fe1cc06b360 msgr2=0x7fe1cc0612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 -- 172.21.15.190:0/1274170948 shutdown_connections 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.756+0000 7fe1d1422700 1 -- 172.21.15.190:0/1274170948 wait complete. 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.757+0000 7fe1d1422700 1 Processor -- start 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.757+0000 7fe1d1422700 1 -- start start 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1d1422700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1d1422700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc146440 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1d1422700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc147240 con 0x7fe1cc136a10 2020-04-02T23:48:29.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1d1422700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0ab110 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1cb7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe1cc136a10 0x7fe1cc142dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53756/0 (socket says 172.21.15.190:53756) 2020-04-02T23:48:29.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.758+0000 7fe1cb7fe700 1 -- 172.21.15.190:0/2970898427 learned_addr learned my addr 172.21.15.190:0/2970898427 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:29.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.759+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.763 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.761+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071837306 0 0) 0x7fe1cc147240 con 0x7fe1cc136a10 2020-04-02T23:48:29.763 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.761+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b0002fe0 con 0x7fe1cc136a10 2020-04-02T23:48:29.764 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.763+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572963580 0 0) 0x7fe1cc146440 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.765 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.763+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc147240 con 0x7fe1cc0a16d0 2020-04-02T23:48:29.767 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.765+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/2970898427 >> v1:172.21.15.190:6789/0 conn(0x7fe1cc136a10 legacy=0x7fe1cc142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.767 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.765+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/2970898427 >> v1:172.21.15.78:6789/0 conn(0x7fe1cc0a16d0 legacy=0x7fe1cc0a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:29.767 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.765+0000 7fe1ca7fc700 1 -- 172.21.15.190:0/2970898427 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc1466a0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.768 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.766+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.768+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> v2:172.21.15.78:3300/0 conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.770 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.768+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.773 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.771+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.771+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b4011e80 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.771+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0a3b60 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.772+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc139bc0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.772+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc056ec0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.774+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.774+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.774+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4007180 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.774+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b40074e0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.955 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.953+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.953+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe1b40056c0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.954+0000 7fe1c3fff700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:29.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.954+0000 7fe1caffd700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:29.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.954+0000 7fe1caffd700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1bc000e90 tx=0x7fe1bc001610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.954+0000 7fe1caffd700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1bc000e90 tx=0x7fe1bc001610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.954+0000 7fe1caffd700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe1bc000e90 tx=0x7fe1bc001610).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:29.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.955+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.955+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe1b4042a10 con 0x7fe1cc0a7bc0 2020-04-02T23:48:29.964 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.963+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:29.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:29.963+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe1b403edb0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:30.107 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.105+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1cc146b10 con 0x7fe1cc0a7bc0 2020-04-02T23:48:30.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.142+0000 7fe1ca7fc700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.142+0000 7fe1c3fff700 1 -- 172.21.15.190:0/2970898427 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fe1b40423d0 con 0x7fe1cc0a7bc0 2020-04-02T23:48:30.144 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:30.144 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:30.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 msgr2=0x7fe1b004ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fe1bc000e90 tx=0x7fe1bc001610).stop 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 msgr2=0x7fe1cc146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fe1cc13a440 tx=0x7fe1b4007a40).stop 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 shutdown_connections 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fe1b004daa0 0x7fe1b004ffb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 --2- 172.21.15.190:0/2970898427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1cc0a7bc0 0x7fe1cc146de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:30.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 >> 172.21.15.190:0/2970898427 conn(0x7fe1cc06b360 msgr2=0x7fe1cc0a7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:30.147 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 shutdown_connections 2020-04-02T23:48:30.147 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.143+0000 7fe1d1422700 1 -- 172.21.15.190:0/2970898427 wait complete. 2020-04-02T23:48:30.156 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:30.170 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-02T23:48:30.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.316+0000 7f603b982700 1 Processor -- start 2020-04-02T23:48:30.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.317+0000 7f603b982700 1 -- start start 2020-04-02T23:48:30.319 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.317+0000 7f603b982700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:30.319 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.317+0000 7f603b982700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340a7bd0 con 0x7f60340aa430 2020-04-02T23:48:30.319 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.317+0000 7f603b982700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603413a320 con 0x7f6034139430 2020-04-02T23:48:30.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.317+0000 7f603b982700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340a9240 con 0x7f60340a7360 2020-04-02T23:48:30.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.318+0000 7f603971e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60340aa430 0x7f60340a4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36160/0 (socket says 172.21.15.190:36160) 2020-04-02T23:48:30.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.318+0000 7f603971e700 1 -- 172.21.15.190:0/3795401295 learned_addr learned my addr 172.21.15.190:0/3795401295 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:30.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.318+0000 7f6038f1d700 1 --1- 172.21.15.190:0/3795401295 >> v1:172.21.15.190:6789/0 conn(0x7f6034139430 0x7f60340a8050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53760/0 (socket says 172.21.15.190:53760) 2020-04-02T23:48:30.321 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.318+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:30.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780408536 0 0) 0x7f603413a320 con 0x7f6034139430 2020-04-02T23:48:30.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c003230 con 0x7f6034139430 2020-04-02T23:48:30.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724278869 0 0) 0x7f60340a7bd0 con 0x7f60340aa430 2020-04-02T23:48:30.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603413a320 con 0x7f60340aa430 2020-04-02T23:48:30.324 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6039f1f700 1 -- 172.21.15.190:0/3795401295 >> v1:172.21.15.190:6789/0 conn(0x7f6034139430 legacy=0x7f60340a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.324 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6039f1f700 1 -- 172.21.15.190:0/3795401295 >> v1:172.21.15.78:6789/0 conn(0x7f60340aa430 legacy=0x7f60340a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.324 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6039f1f700 1 -- 172.21.15.190:0/3795401295 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034139940 con 0x7f60340a7360 2020-04-02T23:48:30.324 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.321+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f602c0032b0 tx=0x7f602c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.325 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.323+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f602c0032b0 tx=0x7f602c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.325 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.323+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f602c0032b0 tx=0x7f602c008c60).ready entity=mon.2 client_cookie=2157f909a7de7ebf server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:30.327 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.325+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f602c0032b0 tx=0x7f602c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.327 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.325+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f602c011db0 con 0x7f60340a7360 2020-04-02T23:48:30.329 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f602c0032b0 tx=0x7f602c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.329 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f602c0032b0 tx=0x7f602c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.330 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00a160 con 0x7f60340a7360 2020-04-02T23:48:30.330 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f6023fff700 1 -- 172.21.15.190:0/3795401295 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f602c00a500 con 0x7f60340a7360 2020-04-02T23:48:30.330 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f603b982700 1 -- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 msgr2=0x7f60340a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.330 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.327+0000 7f603b982700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f602c0032b0 tx=0x7f602c008c60).stop 2020-04-02T23:48:30.331 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.328+0000 7f603b982700 1 -- 172.21.15.190:0/3795401295 shutdown_connections 2020-04-02T23:48:30.331 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.328+0000 7f603b982700 1 --2- 172.21.15.190:0/3795401295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340a7360 0x7f60340a7770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:30.331 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.328+0000 7f603b982700 1 -- 172.21.15.190:0/3795401295 >> 172.21.15.190:0/3795401295 conn(0x7f603405b3d0 msgr2=0x7f603405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:30.331 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.328+0000 7f603b982700 1 -- 172.21.15.190:0/3795401295 shutdown_connections 2020-04-02T23:48:30.331 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.328+0000 7f603b982700 1 -- 172.21.15.190:0/3795401295 wait complete. 2020-04-02T23:48:30.332 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 Processor -- start 2020-04-02T23:48:30.332 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 -- start start 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6034139430 0x7f60340a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340a40d0 con 0x7f60340a7360 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60340a5ba0 con 0x7f6034139430 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.329+0000 7f603b982700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340a5e40 con 0x7f60340aa430 2020-04-02T23:48:30.333 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.330+0000 7f6038f1d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:30.334 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.330+0000 7f603971e700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f60340a7360 0x7f60340a4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53764/0 (socket says 172.21.15.190:53764) 2020-04-02T23:48:30.334 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.330+0000 7f603971e700 1 -- 172.21.15.190:0/3733836791 learned_addr learned my addr 172.21.15.190:0/3733836791 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:30.334 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.330+0000 7f6039f1f700 1 --2- 172.21.15.190:0/3733836791 >> v2:172.21.15.190:3300/0 conn(0x7f6034139430 0x7f60340a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:30.335 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.334+0000 7f6038f1d700 1 -- 172.21.15.190:0/3733836791 >> v2:172.21.15.190:3300/0 conn(0x7f6034139430 msgr2=0x7f60340a3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.334+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> v2:172.21.15.190:3300/0 conn(0x7f6034139430 0x7f60340a3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:30.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.334+0000 7f6038f1d700 1 -- 172.21.15.190:0/3733836791 >> v1:172.21.15.190:6789/0 conn(0x7f60340a7360 legacy=0x7f60340a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:30.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.334+0000 7f6038f1d700 1 -- 172.21.15.190:0/3733836791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340a6440 con 0x7f60340aa430 2020-04-02T23:48:30.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.334+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.336+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.336+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:30.342 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.342 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6030010440 con 0x7f60340aa430 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000ca60 con 0x7f60340aa430 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f603000ce00 con 0x7f60340aa430 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60340a25d0 con 0x7f60340aa430 2020-04-02T23:48:30.343 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.340+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60341355d0 con 0x7f60340aa430 2020-04-02T23:48:30.344 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.341+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60340a6630 con 0x7f60340aa430 2020-04-02T23:48:30.357 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.355+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.355+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f603000f250 con 0x7f60340aa430 2020-04-02T23:48:30.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.355+0000 7f60227fc700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:30.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.356+0000 7f603971e700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:30.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.356+0000 7f603971e700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6034067db0 tx=0x7f6024001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.356+0000 7f603971e700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6034067db0 tx=0x7f6024001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.356+0000 7f603971e700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f6034067db0 tx=0x7f6024001d10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:30.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.357+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.357+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f603003df40 con 0x7f60340aa430 2020-04-02T23:48:30.532 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.530+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:30.533 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.530+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f603003c140 con 0x7f60340aa430 2020-04-02T23:48:30.719 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:30.717+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60340a6200 con 0x7f60340aa430 2020-04-02T23:48:31.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.245+0000 7f6038f1d700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.245+0000 7f60227fc700 1 -- 172.21.15.190:0/3733836791 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60300100b0 con 0x7f60340aa430 2020-04-02T23:48:31.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 msgr2=0x7f601404faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f6034067db0 tx=0x7f6024001d10).stop 2020-04-02T23:48:31.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 msgr2=0x7f60340a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f60300010d0 tx=0x7f6030010930).stop 2020-04-02T23:48:31.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 shutdown_connections 2020-04-02T23:48:31.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f601404d590 0x7f601404faa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 --2- 172.21.15.190:0/3733836791 >> v2:172.21.15.190:3300/0 conn(0x7f6034139430 0x7f60340a3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 --2- 172.21.15.190:0/3733836791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f60340aa430 0x7f60340a3810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 >> 172.21.15.190:0/3733836791 conn(0x7f603405b3d0 msgr2=0x7f6034138cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:31.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 shutdown_connections 2020-04-02T23:48:31.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.247+0000 7f603b982700 1 -- 172.21.15.190:0/3733836791 wait complete. 2020-04-02T23:48:31.254 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:48:31.259 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:31.268 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:31.272 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:48:31.310 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:31.326 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:48:31.421 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.419+0000 7f6747669700 1 Processor -- start 2020-04-02T23:48:31.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.419+0000 7f6747669700 1 -- start start 2020-04-02T23:48:31.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.420+0000 7f6747669700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f674005c5a0 0x7f6740066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:31.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.420+0000 7f6747669700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:31.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.420+0000 7f6747669700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400a8020 con 0x7f6740139bd0 2020-04-02T23:48:31.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.420+0000 7f6747669700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674005c9b0 con 0x7f674005c5a0 2020-04-02T23:48:31.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.420+0000 7f6747669700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674013a2f0 con 0x7f6740067380 2020-04-02T23:48:31.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.421+0000 7f6744c04700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:31.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.421+0000 7f6745c06700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6740139bd0 0x7f67400a6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36174/0 (socket says 172.21.15.190:36174) 2020-04-02T23:48:31.426 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.421+0000 7f6745c06700 1 -- 172.21.15.190:0/2052269751 learned_addr learned my addr 172.21.15.190:0/2052269751 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:31.426 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.421+0000 7f6745405700 1 --2- 172.21.15.190:0/2052269751 >> v2:172.21.15.78:3300/0 conn(0x7f674005c5a0 0x7f6740066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:31.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.424+0000 7f6744c04700 1 -- 172.21.15.190:0/2052269751 >> v2:172.21.15.78:3300/0 conn(0x7f674005c5a0 msgr2=0x7f6740066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:31.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.424+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> v2:172.21.15.78:3300/0 conn(0x7f674005c5a0 0x7f6740066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:31.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.424+0000 7f6744c04700 1 -- 172.21.15.190:0/2052269751 >> v1:172.21.15.78:6789/0 conn(0x7f6740139bd0 legacy=0x7f67400a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.424+0000 7f6744c04700 1 -- 172.21.15.190:0/2052269751 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674013a590 con 0x7f6740067380 2020-04-02T23:48:31.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.425+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.429 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.427+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.429 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.427+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).ready entity=mon.2 client_cookie=1442900beaf5e98 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:31.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6744c04700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f672ffff700 1 -- 172.21.15.190:0/2052269751 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f673c0113c0 con 0x7f6740067380 2020-04-02T23:48:31.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f672ffff700 1 -- 172.21.15.190:0/2052269751 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c011520 con 0x7f6740067380 2020-04-02T23:48:31.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f672ffff700 1 -- 172.21.15.190:0/2052269751 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f673c011940 con 0x7f6740067380 2020-04-02T23:48:31.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 -- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 msgr2=0x7f6740139770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).stop 2020-04-02T23:48:31.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 -- 172.21.15.190:0/2052269751 shutdown_connections 2020-04-02T23:48:31.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 --2- 172.21.15.190:0/2052269751 >> v2:172.21.15.78:3300/0 conn(0x7f674005c5a0 0x7f6740066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:31.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 --2- 172.21.15.190:0/2052269751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f6740139770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 -- 172.21.15.190:0/2052269751 >> 172.21.15.190:0/2052269751 conn(0x7f67400ac9a0 msgr2=0x7f67400a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:31.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 -- 172.21.15.190:0/2052269751 shutdown_connections 2020-04-02T23:48:31.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.432+0000 7f6747669700 1 -- 172.21.15.190:0/2052269751 wait complete. 2020-04-02T23:48:31.440 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.433+0000 7f6747669700 1 Processor -- start 2020-04-02T23:48:31.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.433+0000 7f6747669700 1 -- start start 2020-04-02T23:48:31.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6747669700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:31.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6747669700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400a5880 con 0x7f6740139bd0 2020-04-02T23:48:31.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6747669700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674013d9e0 con 0x7f674005c5a0 2020-04-02T23:48:31.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6747669700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674009f690 con 0x7f6740067380 2020-04-02T23:48:31.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6745405700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f674005c5a0 0x7f67400a5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53780/0 (socket says 172.21.15.190:53780) 2020-04-02T23:48:31.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.434+0000 7f6745405700 1 -- 172.21.15.190:0/217745796 learned_addr learned my addr 172.21.15.190:0/217745796 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:31.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.435+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:31.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.437+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091669869 0 0) 0x7f674013d9e0 con 0x7f674005c5a0 2020-04-02T23:48:31.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.437+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6720002fe0 con 0x7f674005c5a0 2020-04-02T23:48:31.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.438+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893877041 0 0) 0x7f67400a5880 con 0x7f6740139bd0 2020-04-02T23:48:31.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.438+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f674013d9e0 con 0x7f6740139bd0 2020-04-02T23:48:31.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.439+0000 7f6744c04700 1 -- 172.21.15.190:0/217745796 >> v1:172.21.15.190:6789/0 conn(0x7f674005c5a0 legacy=0x7f67400a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.439+0000 7f6744c04700 1 -- 172.21.15.190:0/217745796 >> v1:172.21.15.78:6789/0 conn(0x7f6740139bd0 legacy=0x7f6740147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.439+0000 7f6744c04700 1 -- 172.21.15.190:0/217745796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674009ef50 con 0x7f6740067380 2020-04-02T23:48:31.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.439+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.442+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.442+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:31.449 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.449 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.450 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.450 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f673c011840 con 0x7f6740067380 2020-04-02T23:48:31.450 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c0119a0 con 0x7f6740067380 2020-04-02T23:48:31.450 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674009f1f0 con 0x7f6740067380 2020-04-02T23:48:31.451 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.446+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f673c007340 con 0x7f6740067380 2020-04-02T23:48:31.451 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.447+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740147770 con 0x7f6740067380 2020-04-02T23:48:31.451 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.447+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740056ec0 con 0x7f6740067380 2020-04-02T23:48:31.628 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.625+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.628 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.626+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f673c0074a0 con 0x7f6740067380 2020-04-02T23:48:31.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.626+0000 7f672e7fc700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:31.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.626+0000 7f6745405700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:31.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.627+0000 7f6745405700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6730007fe0 tx=0x7f67300090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.627+0000 7f6745405700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6730007fe0 tx=0x7f67300090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.627+0000 7f6745405700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f6730007fe0 tx=0x7f67300090b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:31.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.628+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.628+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f673c040cb0 con 0x7f6740067380 2020-04-02T23:48:31.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.635+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.635+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f673c03d050 con 0x7f6740067380 2020-04-02T23:48:31.823 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.821+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f674005cba0 con 0x7f6740067380 2020-04-02T23:48:31.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.837+0000 7f6744c04700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:31.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.837+0000 7f672e7fc700 1 -- 172.21.15.190:0/217745796 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f673c040670 con 0x7f6740067380 2020-04-02T23:48:31.839 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:31.840 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:48:28.761290+0000","modified":"2020-04-02T23:48:31.151521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:48:31.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 msgr2=0x7f672004ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f6730007fe0 tx=0x7f67300090b0).stop 2020-04-02T23:48:31.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 msgr2=0x7f674009d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:31.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f673c002f30 tx=0x7f673c007a40).stop 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 shutdown_connections 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f672004da70 0x7f672004ff80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 --2- 172.21.15.190:0/217745796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6740067380 0x7f674009d7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.838+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 >> 172.21.15.190:0/217745796 conn(0x7f67400ac9a0 msgr2=0x7f674006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.839+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 shutdown_connections 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:31.839+0000 7f6747669700 1 -- 172.21.15.190:0/217745796 wait complete. 2020-04-02T23:48:31.842 INFO:teuthology.orchestra.run.smithi190.stderr:dumped fsmap epoch 3 2020-04-02T23:48:31.851 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:31.904 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:32.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.047+0000 7f7d84193700 1 Processor -- start 2020-04-02T23:48:32.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.047+0000 7f7d84193700 1 -- start start 2020-04-02T23:48:32.051 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.048+0000 7f7d84193700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0677d0 0x7f7d7c13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.048+0000 7f7d84193700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c13cfc0 con 0x7f7d7c139ce0 2020-04-02T23:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.048+0000 7f7d84193700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c13d200 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.048+0000 7f7d84193700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c067be0 con 0x7f7d7c0677d0 2020-04-02T23:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.049+0000 7f7d82730700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7d7c139ce0 0x7f7d7c143f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36186/0 (socket says 172.21.15.190:36186) 2020-04-02T23:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.049+0000 7f7d82730700 1 -- 172.21.15.190:0/3763008026 learned_addr learned my addr 172.21.15.190:0/3763008026 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.049+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0677d0 0x7f7d7c13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.051+0000 7f7d80f2d700 1 -- 172.21.15.190:0/3763008026 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269062576 0 0) 0x7f7d74001450 con 0x7f7d7c139ce0 2020-04-02T23:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.051+0000 7f7d80f2d700 1 -- 172.21.15.190:0/3763008026 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003230 con 0x7f7d7c139ce0 2020-04-02T23:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.052+0000 7f7d81f2f700 1 -- 172.21.15.190:0/3763008026 >> v1:172.21.15.190:6789/0 conn(0x7f7d7c0ac4f0 legacy=0x7f7d7c1395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.052+0000 7f7d81f2f700 1 -- 172.21.15.190:0/3763008026 >> v1:172.21.15.78:6789/0 conn(0x7f7d7c139ce0 legacy=0x7f7d7c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.055 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.052+0000 7f7d81f2f700 1 -- 172.21.15.190:0/3763008026 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c13d4a0 con 0x7f7d7c0677d0 2020-04-02T23:48:32.055 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.053+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.054+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.054+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).ready entity=mon.1 client_cookie=609254b64ba749e9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:32.064 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.064 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d80f2d700 1 -- 172.21.15.190:0/3763008026 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d6c0113c0 con 0x7f7d7c0677d0 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d80f2d700 1 -- 172.21.15.190:0/3763008026 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c011520 con 0x7f7d7c0677d0 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d80f2d700 1 -- 172.21.15.190:0/3763008026 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d6c0118c0 con 0x7f7d7c0677d0 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d84193700 1 -- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 msgr2=0x7f7d7c13cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.061+0000 7f7d84193700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f7d6c002f30 tx=0x7f7d6c007a40).stop 2020-04-02T23:48:32.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.062+0000 7f7d84193700 1 -- 172.21.15.190:0/3763008026 shutdown_connections 2020-04-02T23:48:32.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.062+0000 7f7d84193700 1 --2- 172.21.15.190:0/3763008026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0677d0 0x7f7d7c13cb60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.062+0000 7f7d84193700 1 -- 172.21.15.190:0/3763008026 >> 172.21.15.190:0/3763008026 conn(0x7f7d7c05eff0 msgr2=0x7f7d7c05f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:32.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.062+0000 7f7d84193700 1 -- 172.21.15.190:0/3763008026 shutdown_connections 2020-04-02T23:48:32.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.062+0000 7f7d84193700 1 -- 172.21.15.190:0/3763008026 wait complete. 2020-04-02T23:48:32.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.063+0000 7f7d84193700 1 Processor -- start 2020-04-02T23:48:32.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.063+0000 7f7d84193700 1 -- start start 2020-04-02T23:48:32.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d84193700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:32.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d84193700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d7c139ce0 0x7f7d7c134130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:32.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d84193700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c134590 con 0x7f7d7c0677d0 2020-04-02T23:48:32.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d84193700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c14af80 con 0x7f7d7c139ce0 2020-04-02T23:48:32.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d84193700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c14b220 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.064+0000 7f7d8172e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.065+0000 7f7d82730700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d7c139ce0 0x7f7d7c134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.065+0000 7f7d81f2f700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7d7c0677d0 0x7f7d7c1474b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53790/0 (socket says 172.21.15.190:53790) 2020-04-02T23:48:32.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.065+0000 7f7d81f2f700 1 -- 172.21.15.190:0/3905286675 learned_addr learned my addr 172.21.15.190:0/3905286675 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:32.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.068+0000 7f7d8172e700 1 -- 172.21.15.190:0/3905286675 >> v2:172.21.15.78:3300/0 conn(0x7f7d7c139ce0 msgr2=0x7f7d7c134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.068+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> v2:172.21.15.78:3300/0 conn(0x7f7d7c139ce0 0x7f7d7c134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.068+0000 7f7d8172e700 1 -- 172.21.15.190:0/3905286675 >> v1:172.21.15.190:6789/0 conn(0x7f7d7c0677d0 legacy=0x7f7d7c1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.071 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.068+0000 7f7d8172e700 1 -- 172.21.15.190:0/3905286675 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c14b4c0 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.071 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.068+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.073+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> v2:172.21.15.190:3300/0 conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.073+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7800cc00 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7800cd60 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d780110c0 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c0a1710 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.078+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c0a2520 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.079+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c0a1990 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.094 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.092+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.095 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.092+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7d780064e0 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.095 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.093+0000 7f7d6affd700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:32.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.093+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.093+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d7c0a3430 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.093+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d7c0a3430 tx=0x7f7d6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.093+0000 7f7d81f2f700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f7d7c0a3430 tx=0x7f7d6c007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:32.098 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.094+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.098 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.094+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7d7803ffc0 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.262+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.262+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7d7803c360 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.409+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d7c14b880 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.480 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.477+0000 7f7d8172e700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.480 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.477+0000 7f7d6affd700 1 -- 172.21.15.190:0/3905286675 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f7d7803f980 con 0x7f7d7c0ac4f0 2020-04-02T23:48:32.480 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:32.481 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:32.482 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 msgr2=0x7f7d5c04faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.483 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f7d7c0a3430 tx=0x7f7d6c007a40).stop 2020-04-02T23:48:32.483 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 msgr2=0x7f7d7c14aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.483 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f7d7c05fc80 tx=0x7f7d780108e0).stop 2020-04-02T23:48:32.483 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 shutdown_connections 2020-04-02T23:48:32.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d5c04d590 0x7f7d5c04faa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 --2- 172.21.15.190:0/3905286675 >> v2:172.21.15.78:3300/0 conn(0x7f7d7c139ce0 0x7f7d7c134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 --2- 172.21.15.190:0/3905286675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d7c0ac4f0 0x7f7d7c14aa00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 >> 172.21.15.190:0/3905286675 conn(0x7f7d7c05eff0 msgr2=0x7f7d7c06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:32.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 shutdown_connections 2020-04-02T23:48:32.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.479+0000 7f7d84193700 1 -- 172.21.15.190:0/3905286675 wait complete. 2020-04-02T23:48:32.493 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-02T23:48:32.493 DEBUG:teuthology.misc:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:48:32.493 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-02T23:48:32.493 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:32.507 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2020-04-02T23:48:32.550 INFO:tasks.ceph.mds.a:Started 2020-04-02T23:48:32.550 DEBUG:teuthology.misc:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2020-04-02T23:48:32.550 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-02T23:48:32.551 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:48:32.565 INFO:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2020-04-02T23:48:32.608 INFO:tasks.ceph.mds.b:Started 2020-04-02T23:48:32.608 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:32.609 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-02T23:48:32.623 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:32.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.774+0000 7f23de946700 1 Processor -- start 2020-04-02T23:48:32.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.774+0000 7f23de946700 1 -- start start 2020-04-02T23:48:32.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.775+0000 7f23de946700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:32.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.775+0000 7f23de946700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:32.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.775+0000 7f23de946700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d813cfc0 con 0x7f23d80ac4f0 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.775+0000 7f23de946700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8067be0 con 0x7f23d80677d0 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.775+0000 7f23de946700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d813d200 con 0x7f23d8139ce0 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.776+0000 7f23d7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.776+0000 7f23dcee3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.776+0000 7f23dcee3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46436/0 (socket says 172.21.15.190:46436) 2020-04-02T23:48:32.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.776+0000 7f23dcee3700 1 -- 172.21.15.190:0/259866695 learned_addr learned my addr 172.21.15.190:0/259866695 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:32.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.779+0000 7f23dcee3700 1 -- 172.21.15.190:0/259866695 >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 msgr2=0x7f23d813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:32.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.779+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d813cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:32.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.779+0000 7f23dcee3700 1 -- 172.21.15.190:0/259866695 >> v1:172.21.15.190:6789/0 conn(0x7f23d80ac4f0 legacy=0x7f23d81395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:32.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.779+0000 7f23dcee3700 1 -- 172.21.15.190:0/259866695 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d813d4a0 con 0x7f23d8139ce0 2020-04-02T23:48:32.782 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.779+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.783 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.781+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.783 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.781+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).ready entity=mon.2 client_cookie=496667b69eadb024 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:32.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.784+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.784+0000 7f23d77fe700 1 -- 172.21.15.190:0/259866695 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d0011ea0 con 0x7f23d8139ce0 2020-04-02T23:48:32.789 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.789 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23dcee3700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23d77fe700 1 -- 172.21.15.190:0/259866695 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000a160 con 0x7f23d8139ce0 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23d77fe700 1 -- 172.21.15.190:0/259866695 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d000a580 con 0x7f23d8139ce0 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 -- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 msgr2=0x7f23d813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f23d805fc80 tx=0x7f23d0007dc0).stop 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 -- 172.21.15.190:0/259866695 shutdown_connections 2020-04-02T23:48:32.790 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 --2- 172.21.15.190:0/259866695 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23d8139ce0 0x7f23d813a0f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 --2- 172.21.15.190:0/259866695 >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 -- 172.21.15.190:0/259866695 >> 172.21.15.190:0/259866695 conn(0x7f23d805eff0 msgr2=0x7f23d805f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 -- 172.21.15.190:0/259866695 shutdown_connections 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.786+0000 7f23de946700 1 -- 172.21.15.190:0/259866695 wait complete. 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.787+0000 7f23de946700 1 Processor -- start 2020-04-02T23:48:32.791 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.787+0000 7f23de946700 1 -- start start 2020-04-02T23:48:32.792 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.788+0000 7f23de946700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d80a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:32.792 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.788+0000 7f23de946700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80a3270 con 0x7f23d8139ce0 2020-04-02T23:48:32.793 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.788+0000 7f23de946700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8136110 con 0x7f23d80ac4f0 2020-04-02T23:48:32.793 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.788+0000 7f23de946700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8136fe0 con 0x7f23d80677d0 2020-04-02T23:48:32.793 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.788+0000 7f23d7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d80a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.793 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.789+0000 7f23dcee3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23d8139ce0 0x7f23d8132d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36208/0 (socket says 172.21.15.190:36208) 2020-04-02T23:48:32.793 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.789+0000 7f23dcee3700 1 -- 172.21.15.190:0/2153465535 learned_addr learned my addr 172.21.15.190:0/2153465535 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:32.794 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.792+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705064580 0 0) 0x7f23d80a3270 con 0x7f23d8139ce0 2020-04-02T23:48:32.794 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.792+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23bc002fe0 con 0x7f23d8139ce0 2020-04-02T23:48:32.795 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.793+0000 7f23d7fff700 1 -- 172.21.15.190:0/2153465535 >> v1:172.21.15.190:6789/0 conn(0x7f23d80ac4f0 legacy=0x7f23d8136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.795 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.793+0000 7f23d7fff700 1 -- 172.21.15.190:0/2153465535 >> v1:172.21.15.78:6789/0 conn(0x7f23d8139ce0 legacy=0x7f23d8132d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:32.795 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.793+0000 7f23d7fff700 1 -- 172.21.15.190:0/2153465535 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8135e70 con 0x7f23d80677d0 2020-04-02T23:48:32.796 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.794+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.797 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.795+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> v2:172.21.15.190:3300/0 conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.798 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.795+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:32.804 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.804 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.804 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.805 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c8007530 con 0x7f23d80677d0 2020-04-02T23:48:32.805 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80056c0 con 0x7f23d80677d0 2020-04-02T23:48:32.805 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c8005ae0 con 0x7f23d80677d0 2020-04-02T23:48:32.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.801+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8133f70 con 0x7f23d80677d0 2020-04-02T23:48:32.806 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.802+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80b0430 con 0x7f23d80677d0 2020-04-02T23:48:32.807 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.803+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d81365c0 con 0x7f23d80677d0 2020-04-02T23:48:32.830 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.828+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.831 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.828+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f23c8005c40 con 0x7f23d80677d0 2020-04-02T23:48:32.831 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.828+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.831 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.828+0000 7f23d5ffb700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:32.832 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.829+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f23c800d0c0 con 0x7f23d80677d0 2020-04-02T23:48:32.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.829+0000 7f23cffff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:32.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.829+0000 7f23cffff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23d8136fa0 tx=0x7f23c00014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.829+0000 7f23cffff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23d8136fa0 tx=0x7f23c00014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:32.833 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.829+0000 7f23cffff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f23d8136fa0 tx=0x7f23c00014a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.000 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.995+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.001 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:32.995+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f23c803cb20 con 0x7f23d80677d0 2020-04-02T23:48:33.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.140+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d8056ec0 con 0x7f23d80677d0 2020-04-02T23:48:33.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.170+0000 7f23d7fff700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.170+0000 7f23d5ffb700 1 -- 172.21.15.190:0/2153465535 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f23c8040140 con 0x7f23d80677d0 2020-04-02T23:48:33.173 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:33.173 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:33.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 msgr2=0x7f23bc04fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f23d8136fa0 tx=0x7f23c00014a0).stop 2020-04-02T23:48:33.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 msgr2=0x7f23d80a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f23c8002f30 tx=0x7f23c8010bb0).stop 2020-04-02T23:48:33.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 shutdown_connections 2020-04-02T23:48:33.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f23bc04d920 0x7f23bc04fe30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 --2- 172.21.15.190:0/2153465535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f23d80677d0 0x7f23d80a26a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 >> 172.21.15.190:0/2153465535 conn(0x7f23d805eff0 msgr2=0x7f23d80abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:33.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.171+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 shutdown_connections 2020-04-02T23:48:33.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.172+0000 7f23de946700 1 -- 172.21.15.190:0/2153465535 wait complete. 2020-04-02T23:48:33.186 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:27.771838+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:17.905670+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'21', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:22.984948+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:25.792553+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:48:33.186 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:33.200 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:48:33.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.351+0000 7ff95a995700 1 Processor -- start 2020-04-02T23:48:33.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.351+0000 7ff95a995700 1 -- start start 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.352+0000 7ff95a995700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff954137470 0x7ff954137880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.352+0000 7ff95a995700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 0x7ff9540a8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.352+0000 7ff95a995700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540a6180 con 0x7ff9540a4f70 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.352+0000 7ff95a995700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540a6d90 con 0x7ff954137470 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.352+0000 7ff95a995700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540a63b0 con 0x7ff9540a8370 2020-04-02T23:48:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.353+0000 7ff94bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff954137470 0x7ff954137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.353+0000 7ff958f32700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 0x7ff9540a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.353+0000 7ff958f32700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 0x7ff9540a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46450/0 (socket says 172.21.15.190:46450) 2020-04-02T23:48:33.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.353+0000 7ff958f32700 1 -- 172.21.15.190:0/619489795 learned_addr learned my addr 172.21.15.190:0/619489795 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:33.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.356+0000 7ff94bfff700 1 -- 172.21.15.190:0/619489795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 msgr2=0x7ff9540a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:33.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.356+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 0x7ff9540a8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:33.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.356+0000 7ff94bfff700 1 -- 172.21.15.190:0/619489795 >> v1:172.21.15.190:6789/0 conn(0x7ff9540a4f70 legacy=0x7ff9540a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:33.358 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.356+0000 7ff94bfff700 1 -- 172.21.15.190:0/619489795 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540a6650 con 0x7ff954137470 2020-04-02T23:48:33.359 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.357+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> v2:172.21.15.190:3300/0 conn(0x7ff954137470 0x7ff954137880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff95405bef0 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.359+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> v2:172.21.15.190:3300/0 conn(0x7ff954137470 0x7ff954137880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff95405bef0 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.359+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff95405bef0 tx=0x7ff93c007a40).ready entity=mon.1 client_cookie=27d2b2e5d473d2fc server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff95405bef0 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff95405bef0 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff94bfff700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7ff95405bef0 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff9537fe700 1 -- 172.21.15.190:0/619489795 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c011380 con 0x7ff954137470 2020-04-02T23:48:33.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff9537fe700 1 -- 172.21.15.190:0/619489795 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0114e0 con 0x7ff954137470 2020-04-02T23:48:33.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff9537fe700 1 -- 172.21.15.190:0/619489795 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c011900 con 0x7ff954137470 2020-04-02T23:48:33.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 -- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 msgr2=0x7ff954137880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7ff95405bef0 tx=0x7ff93c007a40).stop 2020-04-02T23:48:33.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 -- 172.21.15.190:0/619489795 shutdown_connections 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff9540a8370 0x7ff9540a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 --2- 172.21.15.190:0/619489795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff954137470 0x7ff954137880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.364+0000 7ff95a995700 1 -- 172.21.15.190:0/619489795 >> 172.21.15.190:0/619489795 conn(0x7ff95405b3d0 msgr2=0x7ff95405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.365+0000 7ff95a995700 1 -- 172.21.15.190:0/619489795 shutdown_connections 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.365+0000 7ff95a995700 1 -- 172.21.15.190:0/619489795 wait complete. 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.365+0000 7ff95a995700 1 Processor -- start 2020-04-02T23:48:33.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.365+0000 7ff95a995700 1 -- start start 2020-04-02T23:48:33.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.366+0000 7ff95a995700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff9540a8370 0x7ff9540a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:33.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.366+0000 7ff95a995700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff954147650 con 0x7ff954137470 2020-04-02T23:48:33.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.366+0000 7ff95a995700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9541478f0 con 0x7ff9540a4f70 2020-04-02T23:48:33.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.366+0000 7ff95a995700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff954147b90 con 0x7ff9540a8370 2020-04-02T23:48:33.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.366+0000 7ff94bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff9540a8370 0x7ff9540a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.367+0000 7ff953fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff9540a4f70 0x7ff9540a3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53818/0 (socket says 172.21.15.190:53818) 2020-04-02T23:48:33.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.367+0000 7ff953fff700 1 -- 172.21.15.190:0/1221994590 learned_addr learned my addr 172.21.15.190:0/1221994590 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:33.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.371+0000 7ff94bfff700 1 -- 172.21.15.190:0/1221994590 >> v1:172.21.15.190:6789/0 conn(0x7ff9540a4f70 legacy=0x7ff9540a3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.371+0000 7ff94bfff700 1 -- 172.21.15.190:0/1221994590 >> v1:172.21.15.78:6789/0 conn(0x7ff954137470 legacy=0x7ff954066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.373 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.371+0000 7ff94bfff700 1 -- 172.21.15.190:0/1221994590 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954067240 con 0x7ff9540a8370 2020-04-02T23:48:33.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.371+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> v2:172.21.15.190:3300/0 conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.374+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> v2:172.21.15.190:3300/0 conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.374+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.379+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.380+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c011800 con 0x7ff9540a8370 2020-04-02T23:48:33.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.380+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9541470a0 con 0x7ff9540a8370 2020-04-02T23:48:33.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.380+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954066080 con 0x7ff9540a8370 2020-04-02T23:48:33.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.381+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954147d50 con 0x7ff9540a8370 2020-04-02T23:48:33.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.536+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.536+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.536+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c011960 con 0x7ff9540a8370 2020-04-02T23:48:33.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.536+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93c007340 con 0x7ff9540a8370 2020-04-02T23:48:33.585 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.583+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff93c0056c0 con 0x7ff9540a8370 2020-04-02T23:48:33.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff951ffb700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff93c061960 con 0x7ff9540a8370 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff93c061e20 con 0x7ff9540a8370 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff953fff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff953fff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff944002040 tx=0x7ff944002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.584+0000 7ff953fff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff944002040 tx=0x7ff944002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.585+0000 7ff953fff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7ff944002040 tx=0x7ff944002520).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.734+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff954147d50 con 0x7ff9540a8370 2020-04-02T23:48:33.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.741+0000 7ff94bfff700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.741+0000 7ff951ffb700 1 -- 172.21.15.190:0/1221994590 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff93c03d160 con 0x7ff9540a8370 2020-04-02T23:48:33.743 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 1 2020-04-02T23:48:33.745 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 msgr2=0x7ff93804f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.745 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7ff944002040 tx=0x7ff944002520).stop 2020-04-02T23:48:33.745 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 msgr2=0x7ff9540a2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7ff95409f010 tx=0x7ff93c007a40).stop 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 shutdown_connections 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff93804d4e0 0x7ff93804f9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 --2- 172.21.15.190:0/1221994590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9540a8370 0x7ff9540a2d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 >> 172.21.15.190:0/1221994590 conn(0x7ff95405b3d0 msgr2=0x7ff9540a8780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 shutdown_connections 2020-04-02T23:48:33.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.743+0000 7ff95a995700 1 -- 172.21.15.190:0/1221994590 wait complete. 2020-04-02T23:48:33.756 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:33.769 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:48:33.922 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.920+0000 7f16a9808700 1 Processor -- start 2020-04-02T23:48:33.922 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.920+0000 7f16a9808700 1 -- start start 2020-04-02T23:48:33.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.921+0000 7f16a9808700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16a40a4f70 0x7f16a40a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:33.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.921+0000 7f16a9808700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:33.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.921+0000 7f16a9808700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a40a6180 con 0x7f16a41378d0 2020-04-02T23:48:33.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.921+0000 7f16a9808700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40a0be0 con 0x7f16a40a07d0 2020-04-02T23:48:33.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.921+0000 7f16a9808700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40a63b0 con 0x7f16a40a4f70 2020-04-02T23:48:33.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.922+0000 7f16a27fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.922+0000 7f16a2ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16a40a4f70 0x7f16a40a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.922+0000 7f16a2ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16a40a4f70 0x7f16a40a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60606/0 (socket says 172.21.15.190:60606) 2020-04-02T23:48:33.924 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.922+0000 7f16a2ffd700 1 -- 172.21.15.190:0/2041420694 learned_addr learned my addr 172.21.15.190:0/2041420694 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:33.927 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.925+0000 7f16a2ffd700 1 -- 172.21.15.190:0/2041420694 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 msgr2=0x7f16a4137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:33.927 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.925+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:33.927 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.925+0000 7f16a2ffd700 1 -- 172.21.15.190:0/2041420694 >> v1:172.21.15.78:6789/0 conn(0x7f16a41378d0 legacy=0x7f16a40a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.927 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.925+0000 7f16a2ffd700 1 -- 172.21.15.190:0/2041420694 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40a6650 con 0x7f16a40a4f70 2020-04-02T23:48:33.928 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.925+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> v2:172.21.15.190:3300/0 conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.933 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.927+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> v2:172.21.15.190:3300/0 conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.933 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.927+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).ready entity=mon.1 client_cookie=b36ec7cf8e47b5b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a1ffb700 1 -- 172.21.15.190:0/2041420694 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169c00a160 con 0x7f16a40a4f70 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a1ffb700 1 -- 172.21.15.190:0/2041420694 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00a2c0 con 0x7f16a40a4f70 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a1ffb700 1 -- 172.21.15.190:0/2041420694 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169c00a6a0 con 0x7f16a40a4f70 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a9808700 1 -- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 msgr2=0x7f16a40a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.931+0000 7f16a9808700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).stop 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 -- 172.21.15.190:0/2041420694 shutdown_connections 2020-04-02T23:48:33.935 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 --2- 172.21.15.190:0/2041420694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a40a4f70 0x7f16a40a0370 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:33.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 --2- 172.21.15.190:0/2041420694 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:33.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 -- 172.21.15.190:0/2041420694 >> 172.21.15.190:0/2041420694 conn(0x7f16a405b3d0 msgr2=0x7f16a405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:33.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 -- 172.21.15.190:0/2041420694 shutdown_connections 2020-04-02T23:48:33.936 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.932+0000 7f16a9808700 1 -- 172.21.15.190:0/2041420694 wait complete. 2020-04-02T23:48:33.937 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.933+0000 7f16a9808700 1 Processor -- start 2020-04-02T23:48:33.937 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.933+0000 7f16a9808700 1 -- start start 2020-04-02T23:48:33.937 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a9808700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a9808700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a4147300 con 0x7f16a40a4f70 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a9808700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a41475a0 con 0x7f16a41378d0 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a9808700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a4147030 con 0x7f16a40a07d0 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a37fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f16a41378d0 0x7f16a40665f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53834/0 (socket says 172.21.15.190:53834) 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.934+0000 7f16a37fe700 1 -- 172.21.15.190:0/4109896706 learned_addr learned my addr 172.21.15.190:0/4109896706 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:33.938 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.935+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.939 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.937+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203020041 0 0) 0x7f16a41475a0 con 0x7f16a41378d0 2020-04-02T23:48:33.939 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.937+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1688002fe0 con 0x7f16a41378d0 2020-04-02T23:48:33.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.940+0000 7f16a2ffd700 1 -- 172.21.15.190:0/4109896706 >> v1:172.21.15.190:6789/0 conn(0x7f16a41378d0 legacy=0x7f16a40665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.940+0000 7f16a2ffd700 1 -- 172.21.15.190:0/4109896706 >> v1:172.21.15.78:6789/0 conn(0x7f16a40a4f70 legacy=0x7f16a40a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:33.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.941+0000 7f16a2ffd700 1 -- 172.21.15.190:0/4109896706 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40a30f0 con 0x7f16a40a07d0 2020-04-02T23:48:33.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.941+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.950 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.948+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> v2:172.21.15.78:3300/0 conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.950 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.948+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:33.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169c00a720 con 0x7f16a40a07d0 2020-04-02T23:48:33.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c005c30 con 0x7f16a40a07d0 2020-04-02T23:48:33.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a4066d00 con 0x7f16a40a07d0 2020-04-02T23:48:33.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169c007150 con 0x7f16a40a07d0 2020-04-02T23:48:33.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.955+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a40a4570 con 0x7f16a40a07d0 2020-04-02T23:48:33.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.956+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4147170 con 0x7f16a40a07d0 2020-04-02T23:48:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.969+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.969+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f169c0073c0 con 0x7f16a40a07d0 2020-04-02T23:48:33.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.970+0000 7f169bfff700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:33.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.970+0000 7f16a27fc700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:33.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.970+0000 7f16a27fc700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16a40a38a0 tx=0x7f168c00c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.970+0000 7f16a27fc700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16a40a38a0 tx=0x7f168c00c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:33.970+0000 7f16a27fc700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f16a40a38a0 tx=0x7f168c00c830).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:34.147 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.145+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.148 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.145+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f169c041680 con 0x7f16a40a07d0 2020-04-02T23:48:34.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.152+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.152+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f169c03da20 con 0x7f16a40a07d0 2020-04-02T23:48:34.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.296+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16a4056ec0 con 0x7f16a40a07d0 2020-04-02T23:48:34.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.313+0000 7f16a2ffd700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.313+0000 7f169bfff700 1 -- 172.21.15.190:0/4109896706 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f169c041040 con 0x7f16a40a07d0 2020-04-02T23:48:34.316 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:34.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 msgr2=0x7f168804fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f16a40a38a0 tx=0x7f168c00c830).stop 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 msgr2=0x7f16a4065f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f169c0032b0 tx=0x7f169c007dc0).stop 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 shutdown_connections 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f168804d920 0x7f168804fe30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 --2- 172.21.15.190:0/4109896706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40a07d0 0x7f16a4065f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 >> 172.21.15.190:0/4109896706 conn(0x7f16a405b3d0 msgr2=0x7f16a41323e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:34.318 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 shutdown_connections 2020-04-02T23:48:34.319 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.315+0000 7f16a9808700 1 -- 172.21.15.190:0/4109896706 wait complete. 2020-04-02T23:48:34.327 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:34.341 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:48:34.493 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.491+0000 7fd849053700 1 Processor -- start 2020-04-02T23:48:34.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.491+0000 7fd849053700 1 -- start start 2020-04-02T23:48:34.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.492+0000 7fd849053700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8440a3f20 0x7fd8440a4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:34.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.492+0000 7fd849053700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440a70d0 0x7fd8440a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:34.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.492+0000 7fd849053700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440a5220 con 0x7fd8441398b0 2020-04-02T23:48:34.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.492+0000 7fd849053700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440a7cd0 con 0x7fd8440a3f20 2020-04-02T23:48:34.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.492+0000 7fd849053700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440a7940 con 0x7fd8440a70d0 2020-04-02T23:48:34.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.528+0000 7fd842d9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8440a3f20 0x7fd8440a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:34.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.529+0000 7fd842d9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8440a3f20 0x7fd8440a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60618/0 (socket says 172.21.15.190:60618) 2020-04-02T23:48:34.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.529+0000 7fd842d9d700 1 -- 172.21.15.190:0/3110586422 learned_addr learned my addr 172.21.15.190:0/3110586422 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:34.533 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.531+0000 7fd84259c700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440a70d0 0x7fd8440a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:34.534 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.532+0000 7fd842d9d700 1 -- 172.21.15.190:0/3110586422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440a70d0 msgr2=0x7fd8440a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:34.534 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.532+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440a70d0 0x7fd8440a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:34.534 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.532+0000 7fd842d9d700 1 -- 172.21.15.190:0/3110586422 >> v1:172.21.15.190:6789/0 conn(0x7fd8441398b0 legacy=0x7fd844139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:34.535 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.532+0000 7fd842d9d700 1 -- 172.21.15.190:0/3110586422 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440a54c0 con 0x7fd8440a3f20 2020-04-02T23:48:34.535 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.533+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> v2:172.21.15.190:3300/0 conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd84405c810 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.536 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.534+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> v2:172.21.15.190:3300/0 conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd84405c810 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.537 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.534+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fd84405c810 tx=0x7fd83c007dc0).ready entity=mon.1 client_cookie=4625370151e8b7d6 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fd84405c810 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fd84405c810 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd842d9d700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7fd84405c810 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd841d9b700 1 -- 172.21.15.190:0/3110586422 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd83c011ea0 con 0x7fd8440a3f20 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd841d9b700 1 -- 172.21.15.190:0/3110586422 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00a160 con 0x7fd8440a3f20 2020-04-02T23:48:34.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd841d9b700 1 -- 172.21.15.190:0/3110586422 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd83c00a580 con 0x7fd8440a3f20 2020-04-02T23:48:34.549 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 -- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 msgr2=0x7fd8440a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.549 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fd84405c810 tx=0x7fd83c007dc0).stop 2020-04-02T23:48:34.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 -- 172.21.15.190:0/3110586422 shutdown_connections 2020-04-02T23:48:34.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8440a3f20 0x7fd8440a4330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:34.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 --2- 172.21.15.190:0/3110586422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440a70d0 0x7fd8440a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:34.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 -- 172.21.15.190:0/3110586422 >> 172.21.15.190:0/3110586422 conn(0x7fd844061b20 msgr2=0x7fd8440abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:34.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 -- 172.21.15.190:0/3110586422 shutdown_connections 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.546+0000 7fd849053700 1 -- 172.21.15.190:0/3110586422 wait complete. 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.547+0000 7fd849053700 1 Processor -- start 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.547+0000 7fd849053700 1 -- start start 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd849053700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8440a70d0 0x7fd84409eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd849053700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84412bb50 con 0x7fd8441398b0 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd849053700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84409f1a0 con 0x7fd8440a3f20 2020-04-02T23:48:34.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd849053700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84409efa0 con 0x7fd8440a70d0 2020-04-02T23:48:34.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd842d9d700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd8440a3f20 0x7fd84412afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53844/0 (socket says 172.21.15.190:53844) 2020-04-02T23:48:34.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.548+0000 7fd842d9d700 1 -- 172.21.15.190:0/1119097623 learned_addr learned my addr 172.21.15.190:0/1119097623 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:34.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.550+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> v2:172.21.15.78:3300/0 conn(0x7fd8440a70d0 0x7fd84409eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:34.563 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.561+0000 7fd84259c700 1 -- 172.21.15.190:0/1119097623 >> v1:172.21.15.190:6789/0 conn(0x7fd8440a3f20 legacy=0x7fd84412afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.563 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.561+0000 7fd84259c700 1 -- 172.21.15.190:0/1119097623 >> v1:172.21.15.78:6789/0 conn(0x7fd8441398b0 legacy=0x7fd844148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.561+0000 7fd84259c700 1 -- 172.21.15.190:0/1119097623 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84412a890 con 0x7fd8440a70d0 2020-04-02T23:48:34.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.562+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> v2:172.21.15.78:3300/0 conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.566 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.564+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> v2:172.21.15.78:3300/0 conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.566 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.564+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:34.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c007530 con 0x7fd8440a70d0 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0056c0 con 0x7fd8440a70d0 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd82c005ae0 con 0x7fd8440a70d0 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84412ab30 con 0x7fd8440a70d0 2020-04-02T23:48:34.620 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.617+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84409b990 con 0x7fd8440a70d0 2020-04-02T23:48:34.621 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.618+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84412acc0 con 0x7fd8440a70d0 2020-04-02T23:48:34.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.636+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.636+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd82c005c40 con 0x7fd8440a70d0 2020-04-02T23:48:34.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.636+0000 7fd83bfff700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:34.639 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.637+0000 7fd842d9d700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:34.639 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.637+0000 7fd842d9d700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd84413a3c0 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.639 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.637+0000 7fd842d9d700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd84413a3c0 tx=0x7fd83c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.640 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.637+0000 7fd842d9d700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fd84413a3c0 tx=0x7fd83c007dc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:34.640 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.638+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.640 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.638+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd82c00d0c0 con 0x7fd8440a70d0 2020-04-02T23:48:34.828 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.826+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.828 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.826+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd82c03cb10 con 0x7fd8440a70d0 2020-04-02T23:48:34.970 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.968+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd844056ec0 con 0x7fd8440a70d0 2020-04-02T23:48:34.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.973+0000 7fd84259c700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:34.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.973+0000 7fd83bfff700 1 -- 172.21.15.190:0/1119097623 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd82c040130 con 0x7fd8440a70d0 2020-04-02T23:48:34.976 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:34.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 msgr2=0x7fd82804fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fd84413a3c0 tx=0x7fd83c007dc0).stop 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 msgr2=0x7fd84409eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fd84409b0c0 tx=0x7fd82c010ca0).stop 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 shutdown_connections 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd82804d630 0x7fd82804fb40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 --2- 172.21.15.190:0/1119097623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440a70d0 0x7fd84409eab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 >> 172.21.15.190:0/1119097623 conn(0x7fd844061b20 msgr2=0x7fd84406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:34.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 shutdown_connections 2020-04-02T23:48:34.979 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:34.975+0000 7fd849053700 1 -- 172.21.15.190:0/1119097623 wait complete. 2020-04-02T23:48:34.988 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:35.001 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:48:35.155 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.152+0000 7ff34d500700 1 Processor -- start 2020-04-02T23:48:35.155 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.152+0000 7ff34d500700 1 -- start start 2020-04-02T23:48:35.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.153+0000 7ff34d500700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3480667a0 0x7ff348132d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:35.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.153+0000 7ff34d500700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff3481335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:35.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.153+0000 7ff34d500700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff348139510 con 0x7ff3480a7430 2020-04-02T23:48:35.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.153+0000 7ff34d500700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3480670e0 con 0x7ff3480667a0 2020-04-02T23:48:35.158 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.153+0000 7ff34d500700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff348066bb0 con 0x7ff3481331a0 2020-04-02T23:48:35.158 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.154+0000 7ff34ccff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff3481335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.158 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.154+0000 7ff3477fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3480667a0 0x7ff348132d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.158 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.154+0000 7ff3477fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3480667a0 0x7ff348132d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51506/0 (socket says 172.21.15.190:51506) 2020-04-02T23:48:35.159 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.154+0000 7ff3477fe700 1 -- 172.21.15.190:0/129860084 learned_addr learned my addr 172.21.15.190:0/129860084 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:35.160 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.157+0000 7ff3477fe700 1 -- 172.21.15.190:0/129860084 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 msgr2=0x7ff3481335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:35.160 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.157+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff3481335b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:35.160 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.157+0000 7ff3477fe700 1 -- 172.21.15.190:0/129860084 >> v1:172.21.15.190:6789/0 conn(0x7ff3480a7430 legacy=0x7ff348139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.160 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.157+0000 7ff3477fe700 1 -- 172.21.15.190:0/129860084 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348066e40 con 0x7ff3480667a0 2020-04-02T23:48:35.160 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.157+0000 7ff34ccff700 1 --2- 172.21.15.190:0/129860084 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff3481335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:48:35.161 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.158+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> v2:172.21.15.78:3300/0 conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff338002f30 tx=0x7ff34805c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.161 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.159+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> v2:172.21.15.78:3300/0 conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff338002f30 tx=0x7ff34805c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.162 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.159+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7ff338002f30 tx=0x7ff34805c560).ready entity=mon.0 client_cookie=aa1f963f5708f77 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.166 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff338002f30 tx=0x7ff34805c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff338002f30 tx=0x7ff34805c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff3477fe700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7ff338002f30 tx=0x7ff34805c560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff346ffd700 1 -- 172.21.15.190:0/129860084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff338011670 con 0x7ff3480667a0 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff346ffd700 1 -- 172.21.15.190:0/129860084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380117d0 con 0x7ff3480667a0 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff346ffd700 1 -- 172.21.15.190:0/129860084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff338011bb0 con 0x7ff3480667a0 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 -- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 msgr2=0x7ff348132d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.167 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7ff338002f30 tx=0x7ff34805c560).stop 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 -- 172.21.15.190:0/129860084 shutdown_connections 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 --2- 172.21.15.190:0/129860084 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff3481335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 --2- 172.21.15.190:0/129860084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3480667a0 0x7ff348132d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 -- 172.21.15.190:0/129860084 >> 172.21.15.190:0/129860084 conn(0x7ff348065a20 msgr2=0x7ff348060200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 -- 172.21.15.190:0/129860084 shutdown_connections 2020-04-02T23:48:35.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.164+0000 7ff34d500700 1 -- 172.21.15.190:0/129860084 wait complete. 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.165+0000 7ff34d500700 1 Processor -- start 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.165+0000 7ff34d500700 1 -- start start 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.166+0000 7ff34d500700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3480667a0 0x7ff3481383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.166+0000 7ff34d500700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff34812dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.166+0000 7ff34d500700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff348138b30 con 0x7ff3480a7430 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.166+0000 7ff34d500700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3481468f0 con 0x7ff3481331a0 2020-04-02T23:48:35.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.166+0000 7ff34d500700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff348146ae0 con 0x7ff3480667a0 2020-04-02T23:48:35.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.167+0000 7ff3477fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3480a7430 0x7ff348146f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36260/0 (socket says 172.21.15.190:36260) 2020-04-02T23:48:35.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.167+0000 7ff3477fe700 1 -- 172.21.15.190:0/3984631770 learned_addr learned my addr 172.21.15.190:0/3984631770 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:35.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.167+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff34812dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.167+0000 7ff347fff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3480667a0 0x7ff3481383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.169+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950042041 0 0) 0x7ff348138b30 con 0x7ff3480a7430 2020-04-02T23:48:35.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.169+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff32c002fe0 con 0x7ff3480a7430 2020-04-02T23:48:35.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.171+0000 7ff34ccff700 1 -- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3480667a0 msgr2=0x7ff3481383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.171+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3480667a0 0x7ff3481383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.171+0000 7ff34ccff700 1 -- 172.21.15.190:0/3984631770 >> v1:172.21.15.78:6789/0 conn(0x7ff3480a7430 legacy=0x7ff348146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.171+0000 7ff34ccff700 1 -- 172.21.15.190:0/3984631770 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348138810 con 0x7ff3481331a0 2020-04-02T23:48:35.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.172+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.173+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> v2:172.21.15.190:3300/0 conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.173+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.180 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.180 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34000e160 con 0x7ff3481331a0 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000e300 con 0x7ff3481331a0 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff348147690 con 0x7ff3481331a0 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34000e880 con 0x7ff3481331a0 2020-04-02T23:48:35.181 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.178+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3481318c0 con 0x7ff3481331a0 2020-04-02T23:48:35.182 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.179+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff348138d30 con 0x7ff3481331a0 2020-04-02T23:48:35.194 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.192+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.193+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff34000eaf0 con 0x7ff3481331a0 2020-04-02T23:48:35.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.193+0000 7ff3457fa700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.193+0000 7ff347fff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.194+0000 7ff347fff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3480a6dc0 tx=0x7ff330003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.194+0000 7ff347fff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3480a6dc0 tx=0x7ff330003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.194+0000 7ff347fff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7ff3480a6dc0 tx=0x7ff330003e20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.368+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.368+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff340040460 con 0x7ff3481331a0 2020-04-02T23:48:35.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.376+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.376+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff34003c800 con 0x7ff3481331a0 2020-04-02T23:48:35.538 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.536+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff348056ec0 con 0x7ff3481331a0 2020-04-02T23:48:35.543 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.541+0000 7ff34ccff700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.543 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.541+0000 7ff3457fa700 1 -- 172.21.15.190:0/3984631770 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff34003fe20 con 0x7ff3481331a0 2020-04-02T23:48:35.544 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 msgr2=0x7ff32c04fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7ff3480a6dc0 tx=0x7ff330003e20).stop 2020-04-02T23:48:35.547 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 msgr2=0x7ff34812dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.547 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7ff3400032b0 tx=0x7ff340011060).stop 2020-04-02T23:48:35.547 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 shutdown_connections 2020-04-02T23:48:35.547 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff32c04d8f0 0x7ff32c04fe00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3481331a0 0x7ff34812dbb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 --2- 172.21.15.190:0/3984631770 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3480667a0 0x7ff3481383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 >> 172.21.15.190:0/3984631770 conn(0x7ff348065a20 msgr2=0x7ff3480af860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:35.548 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 shutdown_connections 2020-04-02T23:48:35.549 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.543+0000 7ff34d500700 1 -- 172.21.15.190:0/3984631770 wait complete. 2020-04-02T23:48:35.555 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-02T23:48:35.555 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-02T23:48:35.555 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:35.569 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-02T23:48:35.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 Processor -- start 2020-04-02T23:48:35.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 -- start start 2020-04-02T23:48:35.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39840a85d0 0x7f398413a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:35.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398413adc0 0x7f398413b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:35.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840a89e0 con 0x7f39840a0c50 2020-04-02T23:48:35.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840a8c70 con 0x7f39840a85d0 2020-04-02T23:48:35.723 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.719+0000 7f398a221700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398405bcb0 con 0x7f398413adc0 2020-04-02T23:48:35.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.724+0000 7f3982ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39840a85d0 0x7f398413a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.724+0000 7f3982ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39840a85d0 0x7f398413a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60648/0 (socket says 172.21.15.190:60648) 2020-04-02T23:48:35.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.724+0000 7f3982ffd700 1 -- 172.21.15.190:0/2566314917 learned_addr learned my addr 172.21.15.190:0/2566314917 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:35.728 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.726+0000 7f3983fff700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398413adc0 0x7f398413b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.729 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.727+0000 7f3982ffd700 1 -- 172.21.15.190:0/2566314917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398413adc0 msgr2=0x7f398413b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:35.729 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.727+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398413adc0 0x7f398413b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:35.729 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.727+0000 7f3982ffd700 1 -- 172.21.15.190:0/2566314917 >> v1:172.21.15.190:6789/0 conn(0x7f39840a0c50 legacy=0x7f398405c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:35.729 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.727+0000 7f3982ffd700 1 -- 172.21.15.190:0/2566314917 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398405c860 con 0x7f39840a85d0 2020-04-02T23:48:35.730 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.728+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> v2:172.21.15.190:3300/0 conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39840acfc0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.732 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.730+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> v2:172.21.15.190:3300/0 conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39840acfc0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.732 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.730+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f39840acfc0 tx=0x7f3978007a40).ready entity=mon.1 client_cookie=321345d1564d19b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f39840acfc0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f39840acfc0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f3982ffd700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f39840acfc0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f39827fc700 1 -- 172.21.15.190:0/2566314917 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3978011630 con 0x7f39840a85d0 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f39827fc700 1 -- 172.21.15.190:0/2566314917 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3978011790 con 0x7f39840a85d0 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f39827fc700 1 -- 172.21.15.190:0/2566314917 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3978011bb0 con 0x7f39840a85d0 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f398a221700 1 -- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 msgr2=0x7f398413a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.736+0000 7f398a221700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f39840acfc0 tx=0x7f3978007a40).stop 2020-04-02T23:48:35.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 -- 172.21.15.190:0/2566314917 shutdown_connections 2020-04-02T23:48:35.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398413adc0 0x7f398413b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:35.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 --2- 172.21.15.190:0/2566314917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39840a85d0 0x7f398413a960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 -- 172.21.15.190:0/2566314917 >> 172.21.15.190:0/2566314917 conn(0x7f3984062380 msgr2=0x7f39840ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 -- 172.21.15.190:0/2566314917 shutdown_connections 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.737+0000 7f398a221700 1 -- 172.21.15.190:0/2566314917 wait complete. 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.738+0000 7f398a221700 1 Processor -- start 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.738+0000 7f398a221700 1 -- start start 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f398a221700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39840a0c50 0x7f398409d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.742 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f398a221700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f398413adc0 0x7f3984144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f398a221700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398409f0a0 con 0x7f39840a85d0 2020-04-02T23:48:35.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f398a221700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398409dd50 con 0x7f39840a0c50 2020-04-02T23:48:35.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f398a221700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398409d1b0 con 0x7f398413adc0 2020-04-02T23:48:35.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.739+0000 7f39837fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39840a0c50 0x7f398409d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.744 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.740+0000 7f39837fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39840a0c50 0x7f398409d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51522/0 (socket says 172.21.15.190:51522) 2020-04-02T23:48:35.744 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.740+0000 7f39837fe700 1 -- 172.21.15.190:0/3582479018 learned_addr learned my addr 172.21.15.190:0/3582479018 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:35.744 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.740+0000 7f3983fff700 1 --2- 172.21.15.190:0/3582479018 >> v2:172.21.15.190:3300/0 conn(0x7f398413adc0 0x7f3984144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.745+0000 7f39837fe700 1 -- 172.21.15.190:0/3582479018 >> v2:172.21.15.190:3300/0 conn(0x7f398413adc0 msgr2=0x7f3984144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.745+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> v2:172.21.15.190:3300/0 conn(0x7f398413adc0 0x7f3984144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:35.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.745+0000 7f39837fe700 1 -- 172.21.15.190:0/3582479018 >> v1:172.21.15.190:6789/0 conn(0x7f39840a85d0 legacy=0x7f398409e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:35.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.745+0000 7f39837fe700 1 -- 172.21.15.190:0/3582479018 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398409d450 con 0x7f39840a0c50 2020-04-02T23:48:35.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.747+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> v2:172.21.15.78:3300/0 conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.750 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.749+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> v2:172.21.15.78:3300/0 conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.749+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397400cc20 con 0x7f39840a0c50 2020-04-02T23:48:35.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397400cd80 con 0x7f39840a0c50 2020-04-02T23:48:35.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397400e350 con 0x7f39840a0c50 2020-04-02T23:48:35.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3984144fe0 con 0x7f39840a0c50 2020-04-02T23:48:35.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.754+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398409f760 con 0x7f39840a0c50 2020-04-02T23:48:35.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.755+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3984056ec0 con 0x7f39840a0c50 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.938+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.939+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f39740064e0 con 0x7f39840a0c50 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.939+0000 7f3980ff9700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.939+0000 7f3982ffd700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.940+0000 7f3982ffd700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f398405b4b0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.940+0000 7f3982ffd700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f398405b4b0 tx=0x7f3978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.940+0000 7f3982ffd700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f398405b4b0 tx=0x7f3978007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:35.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.942+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.942+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f39740401e0 con 0x7f39840a0c50 2020-04-02T23:48:35.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.957+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:35.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:35.957+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f397403c520 con 0x7f39840a0c50 2020-04-02T23:48:36.135 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.133+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3984069c30 con 0x7f39840a0c50 2020-04-02T23:48:36.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.245+0000 7f39837fe700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.246+0000 7f3980ff9700 1 -- 172.21.15.190:0/3582479018 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+119887 (secure 0 0 0) 0x7f397403fb40 con 0x7f39840a0c50 2020-04-02T23:48:36.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.247+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 msgr2=0x7f396404fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.247+0000 7f398a221700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f398405b4b0 tx=0x7f3978007a40).stop 2020-04-02T23:48:36.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.247+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 msgr2=0x7f398409d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.247+0000 7f398a221700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f3974001f50 tx=0x7f3974010960).stop 2020-04-02T23:48:36.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 shutdown_connections 2020-04-02T23:48:36.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f396404d530 0x7f396404fa40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 --2- 172.21.15.190:0/3582479018 >> v2:172.21.15.190:3300/0 conn(0x7f398413adc0 0x7f3984144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 --2- 172.21.15.190:0/3582479018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39840a0c50 0x7f398409d8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 >> 172.21.15.190:0/3582479018 conn(0x7f3984062380 msgr2=0x7f398413b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:36.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 shutdown_connections 2020-04-02T23:48:36.253 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.248+0000 7f398a221700 1 -- 172.21.15.190:0/3582479018 wait complete. 2020-04-02T23:48:36.253 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:36.260 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":24250},{"type":"v1","addr":"172.21.15.78:6801","nonce":24250}]},"active_addr":"172.21.15.78:6801/24250","active_change":"2020-04-02T23:47:27.311455+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3985937590}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":4000259183}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":540662704}]}]}} 2020-04-02T23:48:36.267 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-02T23:48:36.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-02T23:48:36.267 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:36.293 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:36.441 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.439+0000 7fd08ac7b700 1 Processor -- start 2020-04-02T23:48:36.442 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.439+0000 7fd08ac7b700 1 -- start start 2020-04-02T23:48:36.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.440+0000 7fd08ac7b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a7650 0x7fd0840a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:36.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.440+0000 7fd08ac7b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd084136060 0x7fd084136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:36.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.440+0000 7fd08ac7b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd084135c00 con 0x7fd0840a8120 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.440+0000 7fd08ac7b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840a7a60 con 0x7fd084136060 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.440+0000 7fd08ac7b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840a7f20 con 0x7fd0840a7650 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.441+0000 7fd083fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd084136060 0x7fd084136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.441+0000 7fd089218700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0840a8120 0x7fd0840a8530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36284/0 (socket says 172.21.15.190:36284) 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.441+0000 7fd089218700 1 -- 172.21.15.190:0/2689256249 learned_addr learned my addr 172.21.15.190:0/2689256249 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:36.444 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.441+0000 7fd088a17700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a7650 0x7fd0840a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:36.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.443+0000 7fd0837fe700 1 -- 172.21.15.190:0/2689256249 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907255082 0 0) 0x7fd084135c00 con 0x7fd0840a8120 2020-04-02T23:48:36.445 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.443+0000 7fd0837fe700 1 -- 172.21.15.190:0/2689256249 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd064003230 con 0x7fd0840a8120 2020-04-02T23:48:36.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.444+0000 7fd083fff700 1 -- 172.21.15.190:0/2689256249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a7650 msgr2=0x7fd0840a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:36.446 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.444+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a7650 0x7fd0840a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:36.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.444+0000 7fd083fff700 1 -- 172.21.15.190:0/2689256249 >> v1:172.21.15.78:6789/0 conn(0x7fd0840a8120 legacy=0x7fd0840a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.444+0000 7fd083fff700 1 -- 172.21.15.190:0/2689256249 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840a6990 con 0x7fd084136060 2020-04-02T23:48:36.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.445+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> v2:172.21.15.190:3300/0 conn(0x7fd084136060 0x7fd084136470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.446+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> v2:172.21.15.190:3300/0 conn(0x7fd084136060 0x7fd084136470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.446+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).ready entity=mon.1 client_cookie=ec4cd59d9f891c8c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:36.454 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.455 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.455 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd0837fe700 1 -- 172.21.15.190:0/2689256249 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd06c011310 con 0x7fd084136060 2020-04-02T23:48:36.455 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd083fff700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.455 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd0837fe700 1 -- 172.21.15.190:0/2689256249 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c011470 con 0x7fd084136060 2020-04-02T23:48:36.455 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd0837fe700 1 -- 172.21.15.190:0/2689256249 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd06c011890 con 0x7fd084136060 2020-04-02T23:48:36.456 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 msgr2=0x7fd084136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.456 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).stop 2020-04-02T23:48:36.456 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2689256249 shutdown_connections 2020-04-02T23:48:36.456 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a7650 0x7fd0840a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:36.457 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2689256249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd084136060 0x7fd084136470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.457 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2689256249 >> 172.21.15.190:0/2689256249 conn(0x7fd08406b360 msgr2=0x7fd0840612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:36.457 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2689256249 shutdown_connections 2020-04-02T23:48:36.457 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.450+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2689256249 wait complete. 2020-04-02T23:48:36.458 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.451+0000 7fd08ac7b700 1 Processor -- start 2020-04-02T23:48:36.458 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.451+0000 7fd08ac7b700 1 -- start start 2020-04-02T23:48:36.458 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.452+0000 7fd08ac7b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:36.458 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.452+0000 7fd08ac7b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd084136060 0x7fd0840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:36.459 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.452+0000 7fd08ac7b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840a2bc0 con 0x7fd0840a7650 2020-04-02T23:48:36.459 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.452+0000 7fd08ac7b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840a2e20 con 0x7fd084136060 2020-04-02T23:48:36.459 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.452+0000 7fd08ac7b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840a30c0 con 0x7fd0840a8120 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.453+0000 7fd083fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.453+0000 7fd089218700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd084136060 0x7fd0840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.453+0000 7fd088a17700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0840a7650 0x7fd0840a5590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36286/0 (socket says 172.21.15.190:36286) 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.453+0000 7fd088a17700 1 -- 172.21.15.190:0/2103333230 learned_addr learned my addr 172.21.15.190:0/2103333230 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.457+0000 7fd083fff700 1 -- 172.21.15.190:0/2103333230 >> v2:172.21.15.78:3300/0 conn(0x7fd084136060 msgr2=0x7fd0840a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.461 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.457+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> v2:172.21.15.78:3300/0 conn(0x7fd084136060 0x7fd0840a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.462 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.457+0000 7fd083fff700 1 -- 172.21.15.190:0/2103333230 >> v1:172.21.15.78:6789/0 conn(0x7fd0840a7650 legacy=0x7fd0840a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.462 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.457+0000 7fd083fff700 1 -- 172.21.15.190:0/2103333230 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840a45a0 con 0x7fd0840a8120 2020-04-02T23:48:36.462 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.457+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.462 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.460+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.462 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.460+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:36.469 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.462+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.469 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.462+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd06c011710 con 0x7fd0840a8120 2020-04-02T23:48:36.469 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.462+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840a3e20 con 0x7fd0840a8120 2020-04-02T23:48:36.470 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.462+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd084064320 con 0x7fd0840a8120 2020-04-02T23:48:36.470 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.463+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd084056ec0 con 0x7fd0840a8120 2020-04-02T23:48:36.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.483+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.483+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c011870 con 0x7fd0840a8120 2020-04-02T23:48:36.486 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.483+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.486 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.483+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd06c007340 con 0x7fd0840a8120 2020-04-02T23:48:36.486 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.483+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.484+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd06c0074a0 con 0x7fd0840a8120 2020-04-02T23:48:36.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.484+0000 7fd081ffb700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:36.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.484+0000 7fd088a17700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:36.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.485+0000 7fd088a17700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd084132bd0 tx=0x7fd07c007e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.485+0000 7fd088a17700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd084132bd0 tx=0x7fd07c007e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.485+0000 7fd088a17700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd084132bd0 tx=0x7fd07c007e20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:36.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.486+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.486+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd06c041010 con 0x7fd0840a8120 2020-04-02T23:48:36.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.661+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.663 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.661+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd06c03d3b0 con 0x7fd0840a8120 2020-04-02T23:48:36.809 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.806+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0840a3200 con 0x7fd0840a8120 2020-04-02T23:48:36.854 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.849+0000 7fd083fff700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:36.854 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.849+0000 7fd081ffb700 1 -- 172.21.15.190:0/2103333230 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fd06c0409d0 con 0x7fd0840a8120 2020-04-02T23:48:36.854 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 msgr2=0x7fd06804fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd084132bd0 tx=0x7fd07c007e20).stop 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 msgr2=0x7fd0840a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fd06c002f30 tx=0x7fd06c007a40).stop 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 shutdown_connections 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd06804d560 0x7fd06804fa70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.855 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2103333230 >> v2:172.21.15.78:3300/0 conn(0x7fd084136060 0x7fd0840a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 --2- 172.21.15.190:0/2103333230 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0840a8120 0x7fd0840a3560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:36.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 >> 172.21.15.190:0/2103333230 conn(0x7fd08406b360 msgr2=0x7fd0840a6100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:36.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 shutdown_connections 2020-04-02T23:48:36.856 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:36.851+0000 7fd08ac7b700 1 -- 172.21.15.190:0/2103333230 wait complete. 2020-04-02T23:48:36.856 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:36.857 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:36.864 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-02T23:48:36.864 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:36.878 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:37.027 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.025+0000 7f59a110d700 1 Processor -- start 2020-04-02T23:48:37.028 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.025+0000 7f59a110d700 1 -- start start 2020-04-02T23:48:37.028 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.026+0000 7f59a110d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f599c09fde0 0x7f599c0a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:37.029 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.026+0000 7f59a110d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0a01f0 con 0x7f599c0a8830 2020-04-02T23:48:37.029 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.026+0000 7f59a110d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0a1220 con 0x7f599c09e940 2020-04-02T23:48:37.029 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.026+0000 7f59a110d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c0a90b0 con 0x7f599c09fde0 2020-04-02T23:48:37.030 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.027+0000 7f599a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f599c09fde0 0x7f599c0a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.030 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.027+0000 7f599b59e700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f599c09e940 0x7f599c13a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53898/0 (socket says 172.21.15.190:53898) 2020-04-02T23:48:37.030 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.027+0000 7f599b59e700 1 -- 172.21.15.190:0/3960702434 learned_addr learned my addr 172.21.15.190:0/3960702434 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:37.037 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.030+0000 7f5999d9b700 1 -- 172.21.15.190:0/3960702434 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474252680 0 0) 0x7f599c0a1220 con 0x7f599c09e940 2020-04-02T23:48:37.037 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.030+0000 7f599a59c700 1 -- 172.21.15.190:0/3960702434 >> v1:172.21.15.190:6789/0 conn(0x7f599c09e940 legacy=0x7f599c13a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.038 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.030+0000 7f599a59c700 1 -- 172.21.15.190:0/3960702434 >> v1:172.21.15.78:6789/0 conn(0x7f599c0a8830 legacy=0x7f599c139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.038 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.030+0000 7f599a59c700 1 -- 172.21.15.190:0/3960702434 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c13a780 con 0x7f599c09fde0 2020-04-02T23:48:37.038 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.031+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> v2:172.21.15.78:3300/0 conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5990002f30 tx=0x7f5990007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.038 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.035+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> v2:172.21.15.78:3300/0 conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5990002f30 tx=0x7f5990007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.038 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.035+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f5990002f30 tx=0x7f5990007a40).ready entity=mon.0 client_cookie=41cf9104bd3682e7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.040 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.038+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f5990002f30 tx=0x7f5990007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.040 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.038+0000 7f5999d9b700 1 -- 172.21.15.190:0/3960702434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5990011470 con 0x7f599c09fde0 2020-04-02T23:48:37.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f5990002f30 tx=0x7f5990007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f599a59c700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f5990002f30 tx=0x7f5990007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f5999d9b700 1 -- 172.21.15.190:0/3960702434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59900115d0 con 0x7f599c09fde0 2020-04-02T23:48:37.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f5999d9b700 1 -- 172.21.15.190:0/3960702434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59900119b0 con 0x7f599c09fde0 2020-04-02T23:48:37.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f59a110d700 1 -- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 msgr2=0x7f599c0a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.040+0000 7f59a110d700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f5990002f30 tx=0x7f5990007a40).stop 2020-04-02T23:48:37.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.041+0000 7f59a110d700 1 -- 172.21.15.190:0/3960702434 shutdown_connections 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.041+0000 7f59a110d700 1 --2- 172.21.15.190:0/3960702434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f599c09fde0 0x7f599c0a0dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.041+0000 7f59a110d700 1 -- 172.21.15.190:0/3960702434 >> 172.21.15.190:0/3960702434 conn(0x7f599c06b360 msgr2=0x7f599c0612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.041+0000 7f59a110d700 1 -- 172.21.15.190:0/3960702434 shutdown_connections 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.041+0000 7f59a110d700 1 -- 172.21.15.190:0/3960702434 wait complete. 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 Processor -- start 2020-04-02T23:48:37.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 -- start start 2020-04-02T23:48:37.045 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.045 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c066850 con 0x7f599c09e940 2020-04-02T23:48:37.045 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0665b0 con 0x7f599c09fde0 2020-04-02T23:48:37.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.042+0000 7f59a110d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c0649d0 con 0x7f599c0a8830 2020-04-02T23:48:37.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.043+0000 7f599ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f599c09e940 0x7f599c0642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36300/0 (socket says 172.21.15.190:36300) 2020-04-02T23:48:37.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.043+0000 7f599ad9d700 1 -- 172.21.15.190:0/1538413805 learned_addr learned my addr 172.21.15.190:0/1538413805 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:37.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.043+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.047 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.046+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431662715 0 0) 0x7f599c066850 con 0x7f599c09e940 2020-04-02T23:48:37.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.046+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5978002fe0 con 0x7f599c09e940 2020-04-02T23:48:37.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.046+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42820149 0 0) 0x7f599c0665b0 con 0x7f599c09fde0 2020-04-02T23:48:37.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.046+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c066850 con 0x7f599c09fde0 2020-04-02T23:48:37.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.048+0000 7f599b59e700 1 -- 172.21.15.190:0/1538413805 >> v1:172.21.15.190:6789/0 conn(0x7f599c09fde0 legacy=0x7f599c133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.048+0000 7f599b59e700 1 -- 172.21.15.190:0/1538413805 >> v1:172.21.15.78:6789/0 conn(0x7f599c09e940 legacy=0x7f599c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.048+0000 7f599b59e700 1 -- 172.21.15.190:0/1538413805 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c063e20 con 0x7f599c0a8830 2020-04-02T23:48:37.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.048+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.054 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.050+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.054 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.050+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598c005ca0 con 0x7f599c0a8830 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c005e00 con 0x7f599c0a8830 2020-04-02T23:48:37.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598c0062b0 con 0x7f599c0a8830 2020-04-02T23:48:37.058 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c148040 con 0x7f599c0a8830 2020-04-02T23:48:37.058 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.054+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c0abc30 con 0x7f599c0a8830 2020-04-02T23:48:37.058 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.055+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c056ec0 con 0x7f599c0a8830 2020-04-02T23:48:37.071 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.069+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.069+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f598c0064e0 con 0x7f599c0a8830 2020-04-02T23:48:37.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.070+0000 7f598bfff700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.070+0000 7f599ad9d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.072 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.070+0000 7f599ad9d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5994001250 tx=0x7f5994001a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.070+0000 7f599ad9d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5994001250 tx=0x7f5994001a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.070+0000 7f599ad9d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5994001250 tx=0x7f5994001a20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.071+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.071+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f598c040260 con 0x7f599c0a8830 2020-04-02T23:48:37.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.248+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.248+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f598c03c5a0 con 0x7f599c0a8830 2020-04-02T23:48:37.394 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.391+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f599c0abc30 con 0x7f599c0a8830 2020-04-02T23:48:37.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.423+0000 7f599b59e700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.423+0000 7f598bfff700 1 -- 172.21.15.190:0/1538413805 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f599c0abc30 con 0x7f599c0a8830 2020-04-02T23:48:37.426 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:37.426 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:37.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.424+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 msgr2=0x7f597804ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.424+0000 7f59a110d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5994001250 tx=0x7f5994001a20).stop 2020-04-02T23:48:37.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.424+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 msgr2=0x7f599c065a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.424+0000 7f59a110d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f598c000e90 tx=0x7f598c010860).stop 2020-04-02T23:48:37.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 shutdown_connections 2020-04-02T23:48:37.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f597804da30 0x7f597804ff40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 --2- 172.21.15.190:0/1538413805 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f599c0a8830 0x7f599c065a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 >> 172.21.15.190:0/1538413805 conn(0x7f599c06b360 msgr2=0x7f599c136e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:37.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 shutdown_connections 2020-04-02T23:48:37.429 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.425+0000 7f59a110d700 1 -- 172.21.15.190:0/1538413805 wait complete. 2020-04-02T23:48:37.438 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:37.452 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-02T23:48:37.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.598+0000 7f624f9fc700 1 Processor -- start 2020-04-02T23:48:37.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.598+0000 7f624f9fc700 1 -- start start 2020-04-02T23:48:37.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.598+0000 7f624f9fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:37.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624f9fc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480a3730 con 0x7f6248139dd0 2020-04-02T23:48:37.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624f9fc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480a5320 con 0x7f62480ac2c0 2020-04-02T23:48:37.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624f9fc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480a55c0 con 0x7f6248139560 2020-04-02T23:48:37.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624df99700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6248139dd0 0x7f62481407b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36310/0 (socket says 172.21.15.190:36310) 2020-04-02T23:48:37.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624df99700 1 -- 172.21.15.190:0/4002924455 learned_addr learned my addr 172.21.15.190:0/4002924455 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:37.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.599+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.604 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.602+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740891704 0 0) 0x7f62480a5320 con 0x7f62480ac2c0 2020-04-02T23:48:37.604 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.602+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6230003230 con 0x7f62480ac2c0 2020-04-02T23:48:37.605 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.602+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693946598 0 0) 0x7f62480a3730 con 0x7f6248139dd0 2020-04-02T23:48:37.605 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.602+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62480a5320 con 0x7f6248139dd0 2020-04-02T23:48:37.605 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.603+0000 7f624cf97700 1 -- 172.21.15.190:0/4002924455 >> v1:172.21.15.190:6789/0 conn(0x7f62480ac2c0 legacy=0x7f62480a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.606 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.603+0000 7f624cf97700 1 -- 172.21.15.190:0/4002924455 >> v1:172.21.15.78:6789/0 conn(0x7f6248139dd0 legacy=0x7f62481407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.606 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.603+0000 7f624cf97700 1 -- 172.21.15.190:0/4002924455 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480a5860 con 0x7f6248139560 2020-04-02T23:48:37.606 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.603+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6238002f30 tx=0x7f62380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.607 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.605+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6238002f30 tx=0x7f62380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.607 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.605+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380088e0).ready entity=mon.2 client_cookie=16e468227f501a9b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.612 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f624cf97700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6238008e40 con 0x7f6248139560 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238011540 con 0x7f6248139560 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f6237fff700 1 -- 172.21.15.190:0/4002924455 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6238011960 con 0x7f6248139560 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f624f9fc700 1 -- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 msgr2=0x7f6248139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.613 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.610+0000 7f624f9fc700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380088e0).stop 2020-04-02T23:48:37.615 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.611+0000 7f624f9fc700 1 -- 172.21.15.190:0/4002924455 shutdown_connections 2020-04-02T23:48:37.616 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.611+0000 7f624f9fc700 1 --2- 172.21.15.190:0/4002924455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6248139560 0x7f6248139970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.616 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.611+0000 7f624f9fc700 1 -- 172.21.15.190:0/4002924455 >> 172.21.15.190:0/4002924455 conn(0x7f624805b3d0 msgr2=0x7f624805b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:37.616 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.611+0000 7f624f9fc700 1 -- 172.21.15.190:0/4002924455 shutdown_connections 2020-04-02T23:48:37.616 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.611+0000 7f624f9fc700 1 -- 172.21.15.190:0/4002924455 wait complete. 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.612+0000 7f624f9fc700 1 Processor -- start 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.612+0000 7f624f9fc700 1 -- start start 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624f9fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6248139560 0x7f62480a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624f9fc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480a2400 con 0x7f62480ac2c0 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624f9fc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624814a650 con 0x7f6248139dd0 2020-04-02T23:48:37.617 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624f9fc700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624814a8f0 con 0x7f6248139560 2020-04-02T23:48:37.618 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624d798700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f62480ac2c0 0x7f624814ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36314/0 (socket says 172.21.15.190:36314) 2020-04-02T23:48:37.618 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624d798700 1 -- 172.21.15.190:0/2853778433 learned_addr learned my addr 172.21.15.190:0/2853778433 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:37.618 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.613+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> v2:172.21.15.190:3300/0 conn(0x7f6248139560 0x7f62480a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.616+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243785781 0 0) 0x7f62480a2400 con 0x7f62480ac2c0 2020-04-02T23:48:37.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.616+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6228002fe0 con 0x7f62480ac2c0 2020-04-02T23:48:37.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.617+0000 7f624cf97700 1 -- 172.21.15.190:0/2853778433 >> v1:172.21.15.190:6789/0 conn(0x7f6248139dd0 legacy=0x7f62481477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.617+0000 7f624cf97700 1 -- 172.21.15.190:0/2853778433 >> v1:172.21.15.78:6789/0 conn(0x7f62480ac2c0 legacy=0x7f624814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.619 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.617+0000 7f624cf97700 1 -- 172.21.15.190:0/2853778433 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248147ee0 con 0x7f6248139560 2020-04-02T23:48:37.622 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.620+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> v2:172.21.15.190:3300/0 conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.623 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.621+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> v2:172.21.15.190:3300/0 conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.624 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.621+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.627+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.627+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6238011d30 con 0x7f6248139560 2020-04-02T23:48:37.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.627+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62480667e0 con 0x7f6248139560 2020-04-02T23:48:37.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.627+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6248132d80 con 0x7f6248139560 2020-04-02T23:48:37.630 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.628+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62480a2260 con 0x7f6248139560 2020-04-02T23:48:37.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.629+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.629+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.629+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62480a2260 con 0x7f6248139560 2020-04-02T23:48:37.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.629+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6238011e90 con 0x7f6248139560 2020-04-02T23:48:37.645 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.644+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.646 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.644+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6238007340 con 0x7f6248139560 2020-04-02T23:48:37.646 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.644+0000 7f62367fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.647 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.645+0000 7f624d798700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.647 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.645+0000 7f624d798700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6244000ee0 tx=0x7f6244002790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.647 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.645+0000 7f624d798700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6244000ee0 tx=0x7f6244002790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.648 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.645+0000 7f624d798700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f6244000ee0 tx=0x7f6244002790).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.649+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.649+0000 7f624cf97700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.649+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6238040b00 con 0x7f6248139560 2020-04-02T23:48:37.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.650+0000 7f62367fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] conn(0x7f6228054770 0x7f6228056bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.650+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 --> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62280571a0 con 0x7f6228054770 2020-04-02T23:48:37.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.650+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62380614d0 con 0x7f6248139560 2020-04-02T23:48:37.654 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.650+0000 7f624df99700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] conn(0x7f6228054770 0x7f6228056bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.655 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.653+0000 7f624df99700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] conn(0x7f6228054770 0x7f6228056bc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.753 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.752+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== osd.0 v2:172.21.15.190:6800/24459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f62280571a0 con 0x7f6228054770 2020-04-02T23:48:37.773 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.771+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 --> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62481472a0 con 0x7f6228054770 2020-04-02T23:48:37.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.782+0000 7f62367fc700 1 -- 172.21.15.190:0/2853778433 <== osd.0 v2:172.21.15.190:6800/24459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62481472a0 con 0x7f6228054770 2020-04-02T23:48:37.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] conn(0x7f6228054770 msgr2=0x7f6228056bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:6800/24459,v1:172.21.15.190:6801/24459] conn(0x7f6228054770 0x7f6228056bc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 msgr2=0x7f622804fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f622804d8a0 0x7f622804fdb0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f6244000ee0 tx=0x7f6244002790).stop 2020-04-02T23:48:37.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 msgr2=0x7f62480a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f6238002f30 tx=0x7f62380112f0).stop 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624df99700 1 -- 172.21.15.190:0/2853778433 reap_dead start 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 shutdown_connections 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 --2- 172.21.15.190:0/2853778433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6248139560 0x7f62480a1a80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 >> 172.21.15.190:0/2853778433 conn(0x7f624805b3d0 msgr2=0x7f62480ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:37.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 shutdown_connections 2020-04-02T23:48:37.788 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.783+0000 7f624f9fc700 1 -- 172.21.15.190:0/2853778433 wait complete. 2020-04-02T23:48:37.796 INFO:teuthology.orchestra.run.smithi190.stdout:64424509447 2020-04-02T23:48:37.796 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:37.811 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-02T23:48:37.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.968+0000 7fa74248e700 1 Processor -- start 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.968+0000 7fa74248e700 1 -- start start 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa74248e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa74248e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa74248e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c067c30 con 0x7fa73c139c40 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa74248e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0ac5c0 con 0x7fa73c13a050 2020-04-02T23:48:37.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa74248e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0ac860 con 0x7fa73c05fa80 2020-04-02T23:48:37.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.969+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.970+0000 7fa740a2b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.970+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46564/0 (socket says 172.21.15.190:46564) 2020-04-02T23:48:37.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.970+0000 7fa73bfff700 1 -- 172.21.15.190:0/1956678290 learned_addr learned my addr 172.21.15.190:0/1956678290 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:37.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.972+0000 7fa73bfff700 1 -- 172.21.15.190:0/1956678290 >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 msgr2=0x7fa73c143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:37.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.972+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:37.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.972+0000 7fa73bfff700 1 -- 172.21.15.190:0/1956678290 >> v1:172.21.15.190:6789/0 conn(0x7fa73c139c40 legacy=0x7fa73c067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.972+0000 7fa73bfff700 1 -- 172.21.15.190:0/1956678290 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c13a460 con 0x7fa73c05fa80 2020-04-02T23:48:37.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.972+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa72c002f30 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.976 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.974+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa72c002f30 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.976 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.974+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa72c002f30 tx=0x7fa73c060980).ready entity=mon.2 client_cookie=1b1a222ab50a3ee2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.982 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.979+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa72c002f30 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.982 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.979+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa72c002f30 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.982 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.979+0000 7fa73bfff700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa72c002f30 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.982 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.979+0000 7fa73affd700 1 -- 172.21.15.190:0/1956678290 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c011670 con 0x7fa73c05fa80 2020-04-02T23:48:37.982 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa73affd700 1 -- 172.21.15.190:0/1956678290 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c0117d0 con 0x7fa73c05fa80 2020-04-02T23:48:37.983 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa73affd700 1 -- 172.21.15.190:0/1956678290 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72c011bf0 con 0x7fa73c05fa80 2020-04-02T23:48:37.983 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 -- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 msgr2=0x7fa73c0acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.983 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa72c002f30 tx=0x7fa73c060980).stop 2020-04-02T23:48:37.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 -- 172.21.15.190:0/1956678290 shutdown_connections 2020-04-02T23:48:37.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 --2- 172.21.15.190:0/1956678290 >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:37.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 --2- 172.21.15.190:0/1956678290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa73c05fa80 0x7fa73c0acd00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 -- 172.21.15.190:0/1956678290 >> 172.21.15.190:0/1956678290 conn(0x7fa73c0656f0 msgr2=0x7fa73c05eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:37.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 -- 172.21.15.190:0/1956678290 shutdown_connections 2020-04-02T23:48:37.985 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.980+0000 7fa74248e700 1 -- 172.21.15.190:0/1956678290 wait complete. 2020-04-02T23:48:37.985 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.982+0000 7fa74248e700 1 Processor -- start 2020-04-02T23:48:37.985 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.982+0000 7fa74248e700 1 -- start start 2020-04-02T23:48:37.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.983+0000 7fa74248e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa73c139c40 0x7fa73c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.983+0000 7fa74248e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c12fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.983+0000 7fa74248e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0adbd0 con 0x7fa73c05fa80 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.983+0000 7fa74248e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0ade70 con 0x7fa73c139c40 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.983+0000 7fa74248e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0af600 con 0x7fa73c13a050 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.984+0000 7fa740a2b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c12fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.984+0000 7fa73b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa73c139c40 0x7fa73c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:37.987 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.984+0000 7fa740a2b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c12fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60720/0 (socket says 172.21.15.190:60720) 2020-04-02T23:48:37.988 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.984+0000 7fa740a2b700 1 -- 172.21.15.190:0/3455142230 learned_addr learned my addr 172.21.15.190:0/3455142230 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:37.989 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.987+0000 7fa740a2b700 1 -- 172.21.15.190:0/3455142230 >> v2:172.21.15.78:3300/0 conn(0x7fa73c139c40 msgr2=0x7fa73c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.989 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.987+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> v2:172.21.15.78:3300/0 conn(0x7fa73c139c40 0x7fa73c0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:37.990 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.987+0000 7fa740a2b700 1 -- 172.21.15.190:0/3455142230 >> v1:172.21.15.78:6789/0 conn(0x7fa73c05fa80 legacy=0x7fa73c0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:37.990 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.987+0000 7fa740a2b700 1 -- 172.21.15.190:0/3455142230 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0af740 con 0x7fa73c13a050 2020-04-02T23:48:37.990 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.989+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.992 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.990+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> v2:172.21.15.190:3300/0 conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.992 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.990+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:37.998 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.998 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.998 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:37.998 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73400e350 con 0x7fa73c13a050 2020-04-02T23:48:37.999 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734005c30 con 0x7fa73c13a050 2020-04-02T23:48:37.999 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa734005e60 con 0x7fa73c13a050 2020-04-02T23:48:37.999 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0ae310 con 0x7fa73c13a050 2020-04-02T23:48:37.999 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.995+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c13cb30 con 0x7fa73c13a050 2020-04-02T23:48:37.999 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:37.996+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa73c0ae070 con 0x7fa73c13a050 2020-04-02T23:48:38.019 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.017+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.021 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.021 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa734012bb0 con 0x7fa73c13a050 2020-04-02T23:48:38.021 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa740a2b700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.021 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.021 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa734061060 con 0x7fa73c13a050 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] conn(0x7fa71c0547e0 0x7fa71c056c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 --> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa71c057210 con 0x7fa71c0547e0 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa734061380 con 0x7fa73c13a050 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.018+0000 7fa73bfff700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.019+0000 7fa73bfff700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa73c13d440 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.019+0000 7fa73bfff700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa73c13d440 tx=0x7fa73c060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.019+0000 7fa73bfff700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa73c13d440 tx=0x7fa73c060980).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.019+0000 7fa73b7fe700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] conn(0x7fa71c0547e0 0x7fa71c056c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.024 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.022+0000 7fa73b7fe700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] conn(0x7fa71c0547e0 0x7fa71c056c30 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.121 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.119+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== osd.1 v2:172.21.15.190:6808/24511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa71c057210 con 0x7fa71c0547e0 2020-04-02T23:48:38.139 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.137+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 --> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa73c1383d0 con 0x7fa71c0547e0 2020-04-02T23:48:38.151 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.147+0000 7fa7397fa700 1 -- 172.21.15.190:0/3455142230 <== osd.1 v2:172.21.15.190:6808/24511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa73c1383d0 con 0x7fa71c0547e0 2020-04-02T23:48:38.151 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] conn(0x7fa71c0547e0 msgr2=0x7fa71c056c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:6808/24511,v1:172.21.15.190:6809/24511] conn(0x7fa71c0547e0 0x7fa71c056c30 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 msgr2=0x7fa71c04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa71c04d570 0x7fa71c04fa80 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa73c13d440 tx=0x7fa73c060980).stop 2020-04-02T23:48:38.152 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 msgr2=0x7fa73c12fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fa7340032b0 tx=0x7fa734010f70).stop 2020-04-02T23:48:38.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa740a2b700 1 -- 172.21.15.190:0/3455142230 reap_dead start 2020-04-02T23:48:38.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 shutdown_connections 2020-04-02T23:48:38.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 --2- 172.21.15.190:0/3455142230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa73c13a050 0x7fa73c12fc60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 >> 172.21.15.190:0/3455142230 conn(0x7fa73c0656f0 msgr2=0x7fa73c0acc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:38.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 shutdown_connections 2020-04-02T23:48:38.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.148+0000 7fa74248e700 1 -- 172.21.15.190:0/3455142230 wait complete. 2020-04-02T23:48:38.160 INFO:teuthology.orchestra.run.smithi190.stdout:64424509448 2020-04-02T23:48:38.161 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:38.175 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-02T23:48:38.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.334+0000 7fb99dcc5700 1 Processor -- start 2020-04-02T23:48:38.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.334+0000 7fb99dcc5700 1 -- start start 2020-04-02T23:48:38.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb99dcc5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb998139c40 0x7fb99813a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb99dcc5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb99dcc5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998067c30 con 0x7fb99805fa80 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb99dcc5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980ad410 con 0x7fb998139c40 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb99dcc5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99813a4b0 con 0x7fb998067120 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb997fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb9977fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb99805fa80 0x7fb9980acd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53946/0 (socket says 172.21.15.190:53946) 2020-04-02T23:48:38.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.335+0000 7fb9977fe700 1 -- 172.21.15.190:0/2683433369 learned_addr learned my addr 172.21.15.190:0/2683433369 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:38.339 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.336+0000 7fb996ffd700 1 --2- 172.21.15.190:0/2683433369 >> v2:172.21.15.78:3300/0 conn(0x7fb998139c40 0x7fb99813a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.340 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.338+0000 7fb997fff700 1 -- 172.21.15.190:0/2683433369 >> v2:172.21.15.78:3300/0 conn(0x7fb998139c40 msgr2=0x7fb99813a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:38.341 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.338+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> v2:172.21.15.78:3300/0 conn(0x7fb998139c40 0x7fb99813a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:38.341 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.338+0000 7fb997fff700 1 -- 172.21.15.190:0/2683433369 >> v1:172.21.15.190:6789/0 conn(0x7fb99805fa80 legacy=0x7fb9980acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.341 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.338+0000 7fb997fff700 1 -- 172.21.15.190:0/2683433369 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980ac5c0 con 0x7fb998067120 2020-04-02T23:48:38.341 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.338+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9900032b0 tx=0x7fb990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.342 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.340+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9900032b0 tx=0x7fb990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.342 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.340+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fb9900032b0 tx=0x7fb990007dc0).ready entity=mon.2 client_cookie=a13d86d417ca27dd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.344 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.342+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb9900032b0 tx=0x7fb990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.345 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.343+0000 7fb9967fc700 1 -- 172.21.15.190:0/2683433369 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb990011e20 con 0x7fb998067120 2020-04-02T23:48:38.346 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb9900032b0 tx=0x7fb990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.346 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb997fff700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7fb9900032b0 tx=0x7fb990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.347 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb9967fc700 1 -- 172.21.15.190:0/2683433369 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000a160 con 0x7fb998067120 2020-04-02T23:48:38.347 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb9967fc700 1 -- 172.21.15.190:0/2683433369 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99000a580 con 0x7fb998067120 2020-04-02T23:48:38.347 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb99dcc5700 1 -- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 msgr2=0x7fb998067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.347 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.344+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fb9900032b0 tx=0x7fb990007dc0).stop 2020-04-02T23:48:38.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 -- 172.21.15.190:0/2683433369 shutdown_connections 2020-04-02T23:48:38.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/2683433369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998067530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/2683433369 >> v2:172.21.15.78:3300/0 conn(0x7fb998139c40 0x7fb99813a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:38.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 -- 172.21.15.190:0/2683433369 >> 172.21.15.190:0/2683433369 conn(0x7fb9980656f0 msgr2=0x7fb99805eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:38.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 -- 172.21.15.190:0/2683433369 shutdown_connections 2020-04-02T23:48:38.349 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.345+0000 7fb99dcc5700 1 -- 172.21.15.190:0/2683433369 wait complete. 2020-04-02T23:48:38.349 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.346+0000 7fb99dcc5700 1 Processor -- start 2020-04-02T23:48:38.349 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.346+0000 7fb99dcc5700 1 -- start start 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb99dcc5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb99dcc5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998136040 con 0x7fb99805fa80 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb99dcc5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998134580 con 0x7fb998139c40 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb99dcc5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980a61a0 con 0x7fb998067120 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb996ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.350 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb997fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb998139c40 0x7fb998151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53956/0 (socket says 172.21.15.190:53956) 2020-04-02T23:48:38.351 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.347+0000 7fb997fff700 1 -- 172.21.15.190:0/1704183042 learned_addr learned my addr 172.21.15.190:0/1704183042 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:38.352 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.350+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256359836 0 0) 0x7fb998134580 con 0x7fb998139c40 2020-04-02T23:48:38.352 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.351+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb978002fe0 con 0x7fb998139c40 2020-04-02T23:48:38.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.351+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538803478 0 0) 0x7fb998136040 con 0x7fb99805fa80 2020-04-02T23:48:38.353 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.351+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb998134580 con 0x7fb99805fa80 2020-04-02T23:48:38.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.352+0000 7fb996ffd700 1 -- 172.21.15.190:0/1704183042 >> v1:172.21.15.190:6789/0 conn(0x7fb998139c40 legacy=0x7fb998151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.352+0000 7fb996ffd700 1 -- 172.21.15.190:0/1704183042 >> v1:172.21.15.78:6789/0 conn(0x7fb99805fa80 legacy=0x7fb99812fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.352+0000 7fb996ffd700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980a62e0 con 0x7fb998067120 2020-04-02T23:48:38.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.353+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.354+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.354+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.360 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98c007530 con 0x7fb998067120 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0056c0 con 0x7fb998067120 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb998134a20 con 0x7fb998067120 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98c005a60 con 0x7fb998067120 2020-04-02T23:48:38.361 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.358+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980a21d0 con 0x7fb998067120 2020-04-02T23:48:38.362 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.359+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb998136240 con 0x7fb998067120 2020-04-02T23:48:38.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.375+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.375+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb98c005cd0 con 0x7fb998067120 2020-04-02T23:48:38.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.376+0000 7fb994ff9700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.376+0000 7fb9977fe700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.376+0000 7fb9977fe700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb988001160 tx=0x7fb998060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.376+0000 7fb9977fe700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb988001160 tx=0x7fb998060980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.376+0000 7fb9977fe700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fb988001160 tx=0x7fb998060980).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb98c0406e0 con 0x7fb998067120 2020-04-02T23:48:38.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb994ff9700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] conn(0x7fb978054b00 0x7fb978056f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb978057530 con 0x7fb978054b00 2020-04-02T23:48:38.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb996ffd700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.381 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb98c061110 con 0x7fb998067120 2020-04-02T23:48:38.381 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2020-04-02T23:48:38.381 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.378+0000 7fb997fff700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] conn(0x7fb978054b00 0x7fb978056f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.381+0000 7fb997fff700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] conn(0x7fb978054b00 0x7fb978056f50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.437 INFO:tasks.ceph.mds.a.smithi190.stdout:starting mds.a at 2020-04-02T23:48:38.477 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.475+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== osd.2 v2:172.21.15.190:6816/24534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fb978057530 con 0x7fb978054b00 2020-04-02T23:48:38.495 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.494+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 --> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb998135da0 con 0x7fb978054b00 2020-04-02T23:48:38.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb994ff9700 1 -- 172.21.15.190:0/1704183042 <== osd.2 v2:172.21.15.190:6816/24534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb998135da0 con 0x7fb978054b00 2020-04-02T23:48:38.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 >> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] conn(0x7fb978054b00 msgr2=0x7fb978056f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.190:6816/24534,v1:172.21.15.190:6817/24534] conn(0x7fb978054b00 0x7fb978056f50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 msgr2=0x7fb97804ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb97804da50 0x7fb97804ff60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fb988001160 tx=0x7fb998060980).stop 2020-04-02T23:48:38.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 msgr2=0x7fb998130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 --2- 172.21.15.190:0/1704183042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb998067120 0x7fb998130370 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fb98c002f30 tx=0x7fb98c010c30).stop 2020-04-02T23:48:38.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb997fff700 1 -- 172.21.15.190:0/1704183042 reap_dead start 2020-04-02T23:48:38.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 shutdown_connections 2020-04-02T23:48:38.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.504+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 >> 172.21.15.190:0/1704183042 conn(0x7fb9980656f0 msgr2=0x7fb99809f140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:38.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.505+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 shutdown_connections 2020-04-02T23:48:38.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.505+0000 7fb99dcc5700 1 -- 172.21.15.190:0/1704183042 wait complete. 2020-04-02T23:48:38.517 INFO:teuthology.orchestra.run.smithi190.stdout:64424509446 2020-04-02T23:48:38.517 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:38.534 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-02T23:48:38.689 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.687+0000 7f7d3030a700 1 Processor -- start 2020-04-02T23:48:38.690 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.687+0000 7f7d3030a700 1 -- start start 2020-04-02T23:48:38.690 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.688+0000 7f7d3030a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7d2805be60 0x7f7d280a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:38.691 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.688+0000 7f7d3030a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d280675c0 0x7f7d280aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:38.691 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.688+0000 7f7d3030a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d280ab1f0 con 0x7f7d280aa090 2020-04-02T23:48:38.691 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.688+0000 7f7d3030a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2805f5b0 con 0x7f7d280675c0 2020-04-02T23:48:38.691 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.688+0000 7f7d3030a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2805f810 con 0x7f7d2805be60 2020-04-02T23:48:38.691 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.689+0000 7f7d2e8a7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d280675c0 0x7f7d280aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.692 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.689+0000 7f7d2e8a7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d280675c0 0x7f7d280aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51622/0 (socket says 172.21.15.190:51622) 2020-04-02T23:48:38.692 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.689+0000 7f7d2e8a7700 1 -- 172.21.15.190:0/474445531 learned_addr learned my addr 172.21.15.190:0/474445531 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:38.692 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.689+0000 7f7d2e0a6700 1 --2- 172.21.15.190:0/474445531 >> v2:172.21.15.190:3300/0 conn(0x7f7d2805be60 0x7f7d280a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.692+0000 7f7d2e8a7700 1 -- 172.21.15.190:0/474445531 >> v2:172.21.15.190:3300/0 conn(0x7f7d2805be60 msgr2=0x7f7d280a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:38.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.692+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> v2:172.21.15.190:3300/0 conn(0x7f7d2805be60 0x7f7d280a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:38.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.692+0000 7f7d2e8a7700 1 -- 172.21.15.190:0/474445531 >> v1:172.21.15.190:6789/0 conn(0x7f7d280aa090 legacy=0x7f7d28066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.692+0000 7f7d2e8a7700 1 -- 172.21.15.190:0/474445531 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2805fab0 con 0x7f7d280675c0 2020-04-02T23:48:38.694 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.692+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> v2:172.21.15.78:3300/0 conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d24002f30 tx=0x7f7d24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.695 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.694+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> v2:172.21.15.78:3300/0 conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d24002f30 tx=0x7f7d24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.696 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.694+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f7d24002f30 tx=0x7f7d24007a40).ready entity=mon.0 client_cookie=10d4f60e5778de9c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.699 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.696+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f7d24002f30 tx=0x7f7d24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.699 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.696+0000 7f7d2d0a4700 1 -- 172.21.15.190:0/474445531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d24011670 con 0x7f7d280675c0 2020-04-02T23:48:38.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f7d24002f30 tx=0x7f7d24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f7d24002f30 tx=0x7f7d24007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d2d0a4700 1 -- 172.21.15.190:0/474445531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d240117d0 con 0x7f7d280675c0 2020-04-02T23:48:38.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d2d0a4700 1 -- 172.21.15.190:0/474445531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d24011bb0 con 0x7f7d280675c0 2020-04-02T23:48:38.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 -- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 msgr2=0x7f7d280aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.702 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f7d24002f30 tx=0x7f7d24007a40).stop 2020-04-02T23:48:38.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 -- 172.21.15.190:0/474445531 shutdown_connections 2020-04-02T23:48:38.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 --2- 172.21.15.190:0/474445531 >> v2:172.21.15.190:3300/0 conn(0x7f7d2805be60 0x7f7d280a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:38.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 --2- 172.21.15.190:0/474445531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d280675c0 0x7f7d280aa4a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 -- 172.21.15.190:0/474445531 >> 172.21.15.190:0/474445531 conn(0x7f7d28063490 msgr2=0x7f7d2805b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 -- 172.21.15.190:0/474445531 shutdown_connections 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.699+0000 7f7d3030a700 1 -- 172.21.15.190:0/474445531 wait complete. 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.700+0000 7f7d3030a700 1 Processor -- start 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.700+0000 7f7d3030a700 1 -- start start 2020-04-02T23:48:38.704 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.701+0000 7f7d3030a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d2805be60 0x7f7d2814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.701+0000 7f7d3030a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.701+0000 7f7d3030a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2814aed0 con 0x7f7d280aa090 2020-04-02T23:48:38.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.701+0000 7f7d3030a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2814a0d0 con 0x7f7d2805be60 2020-04-02T23:48:38.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.701+0000 7f7d3030a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2814a330 con 0x7f7d280675c0 2020-04-02T23:48:38.706 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.702+0000 7f7d2d8a5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.706 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.702+0000 7f7d2e0a6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d2805be60 0x7f7d2814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.706 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.702+0000 7f7d2d8a5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46610/0 (socket says 172.21.15.190:46610) 2020-04-02T23:48:38.706 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.702+0000 7f7d2d8a5700 1 -- 172.21.15.190:0/3777843366 learned_addr learned my addr 172.21.15.190:0/3777843366 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:38.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.706+0000 7f7d2d8a5700 1 -- 172.21.15.190:0/3777843366 >> v2:172.21.15.78:3300/0 conn(0x7f7d2805be60 msgr2=0x7f7d2814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.706+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> v2:172.21.15.78:3300/0 conn(0x7f7d2805be60 0x7f7d2814aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.706+0000 7f7d2d8a5700 1 -- 172.21.15.190:0/3777843366 >> v1:172.21.15.78:6789/0 conn(0x7f7d280aa090 legacy=0x7f7d2809e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.706+0000 7f7d2d8a5700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2814a5d0 con 0x7f7d280675c0 2020-04-02T23:48:38.709 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.706+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.710 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.708+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.710 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.708+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.714 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d1c00cc20 con 0x7f7d280675c0 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00cdc0 con 0x7f7d280675c0 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d280a1d50 con 0x7f7d280675c0 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d1c011170 con 0x7f7d280675c0 2020-04-02T23:48:38.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.712+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d28066be0 con 0x7f7d280675c0 2020-04-02T23:48:38.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.713+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d2814a7d0 con 0x7f7d280675c0 2020-04-02T23:48:38.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.729+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.732 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.730+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7d1c0064e0 con 0x7f7d280675c0 2020-04-02T23:48:38.733 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.731+0000 7f7d1b7fe700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.733 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.731+0000 7f7d2e0a6700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.733 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.731+0000 7f7d2e0a6700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d200032b0 tx=0x7f7d2000f610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.733 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.731+0000 7f7d2e0a6700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d200032b0 tx=0x7f7d2000f610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.733 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.731+0000 7f7d2e0a6700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f7d200032b0 tx=0x7f7d2000f610).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.733+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.733+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7d1c03fd70 con 0x7f7d280675c0 2020-04-02T23:48:38.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.733+0000 7f7d1b7fe700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] conn(0x7f7d08054790 0x7f7d08056be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:38.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.733+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d080571c0 con 0x7f7d08054790 2020-04-02T23:48:38.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.734+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] conn(0x7f7d08054790 0x7f7d08056be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:38.740 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.738+0000 7f7d2e8a7700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] conn(0x7f7d08054790 0x7f7d08056be0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:38.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.747+0000 7f7d2d8a5700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:38.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.747+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1c060800 con 0x7f7d280675c0 2020-04-02T23:48:38.842 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.840+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== osd.3 v2:172.21.15.190:6824/24546 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f7d080571c0 con 0x7f7d08054790 2020-04-02T23:48:38.860 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.858+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 --> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d28066090 con 0x7f7d08054790 2020-04-02T23:48:38.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d1b7fe700 1 -- 172.21.15.190:0/3777843366 <== osd.3 v2:172.21.15.190:6824/24546 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d28066090 con 0x7f7d08054790 2020-04-02T23:48:38.873 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 >> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] conn(0x7f7d08054790 msgr2=0x7f7d08056be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.190:6824/24546,v1:172.21.15.190:6825/24546] conn(0x7f7d08054790 0x7f7d08056be0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 msgr2=0x7f7d0804fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7d0804d5a0 0x7f7d0804fab0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f7d200032b0 tx=0x7f7d2000f610).stop 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 msgr2=0x7f7d280a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 --2- 172.21.15.190:0/3777843366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d280675c0 0x7f7d280a2950 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f7d28060ad0 tx=0x7f7d1c00c460).stop 2020-04-02T23:48:38.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d2e8a7700 1 -- 172.21.15.190:0/3777843366 reap_dead start 2020-04-02T23:48:38.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 shutdown_connections 2020-04-02T23:48:38.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 >> 172.21.15.190:0/3777843366 conn(0x7f7d28063490 msgr2=0x7f7d280ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:38.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 shutdown_connections 2020-04-02T23:48:38.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:38.870+0000 7f7d3030a700 1 -- 172.21.15.190:0/3777843366 wait complete. 2020-04-02T23:48:38.882 INFO:teuthology.orchestra.run.smithi190.stdout:64424509449 2020-04-02T23:48:38.882 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:38.896 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-02T23:48:39.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.040+0000 7ff4e0d3c700 1 Processor -- start 2020-04-02T23:48:39.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.040+0000 7ff4e0d3c700 1 -- start start 2020-04-02T23:48:39.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4e0d3c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.043 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4e0d3c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc05f5b0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4e0d3c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc05f810 con 0x7ff4dc05be60 2020-04-02T23:48:39.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4e0d3c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc05fab0 con 0x7ff4dc0675c0 2020-04-02T23:48:39.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4d9d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff4dc0aa090 0x7ff4dc066eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36386/0 (socket says 172.21.15.190:36386) 2020-04-02T23:48:39.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4d9d9b700 1 -- 172.21.15.190:0/3771642473 learned_addr learned my addr 172.21.15.190:0/3771642473 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:39.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.041+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.044+0000 7ff4d959a700 1 -- 172.21.15.190:0/3771642473 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373407507 0 0) 0x7ff4dc05f5b0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.044+0000 7ff4d959a700 1 -- 172.21.15.190:0/3771642473 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c0003230 con 0x7ff4dc0aa090 2020-04-02T23:48:39.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.047+0000 7ff4dad9d700 1 -- 172.21.15.190:0/3771642473 >> v1:172.21.15.190:6789/0 conn(0x7ff4dc05be60 legacy=0x7ff4dc0a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.047+0000 7ff4dad9d700 1 -- 172.21.15.190:0/3771642473 >> v1:172.21.15.78:6789/0 conn(0x7ff4dc0aa090 legacy=0x7ff4dc066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.047+0000 7ff4dad9d700 1 -- 172.21.15.190:0/3771642473 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc05ff50 con 0x7ff4dc0675c0 2020-04-02T23:48:39.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.048+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.051 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.049+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.051 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.049+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).ready entity=mon.1 client_cookie=4ff8684bbb2e20f3 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4d959a700 1 -- 172.21.15.190:0/3771642473 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4d4011e20 con 0x7ff4dc0675c0 2020-04-02T23:48:39.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4d959a700 1 -- 172.21.15.190:0/3771642473 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d400a160 con 0x7ff4dc0675c0 2020-04-02T23:48:39.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4d959a700 1 -- 172.21.15.190:0/3771642473 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4d400a500 con 0x7ff4dc0675c0 2020-04-02T23:48:39.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 msgr2=0x7ff4dc0aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.054+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).stop 2020-04-02T23:48:39.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.055+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/3771642473 shutdown_connections 2020-04-02T23:48:39.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.055+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/3771642473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0675c0 0x7ff4dc0aa4a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.055+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/3771642473 >> 172.21.15.190:0/3771642473 conn(0x7ff4dc063490 msgr2=0x7ff4dc05b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.055+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/3771642473 shutdown_connections 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.055+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/3771642473 wait complete. 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 Processor -- start 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 -- start start 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4dc0675c0 0x7ff4dc09eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0aa090 0x7ff4dc137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc136040 con 0x7ff4dc05be60 2020-04-02T23:48:39.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc137cb0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.056+0000 7ff4e0d3c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc1362e0 con 0x7ff4dc0675c0 2020-04-02T23:48:39.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.057+0000 7ff4dad9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0aa090 0x7ff4dc137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.057+0000 7ff4dad9d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0aa090 0x7ff4dc137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60774/0 (socket says 172.21.15.190:60774) 2020-04-02T23:48:39.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.057+0000 7ff4dad9d700 1 -- 172.21.15.190:0/692211808 learned_addr learned my addr 172.21.15.190:0/692211808 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:39.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.057+0000 7ff4d9d9b700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4dc0675c0 0x7ff4dc09eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.062 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.059+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702989887 0 0) 0x7ff4dc136040 con 0x7ff4dc05be60 2020-04-02T23:48:39.062 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.060+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b8002fe0 con 0x7ff4dc05be60 2020-04-02T23:48:39.063 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.060+0000 7ff4dad9d700 1 -- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4dc0675c0 msgr2=0x7ff4dc09eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.063 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.060+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4dc0675c0 0x7ff4dc09eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.063 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.060+0000 7ff4dad9d700 1 -- 172.21.15.190:0/692211808 >> v1:172.21.15.78:6789/0 conn(0x7ff4dc05be60 legacy=0x7ff4dc136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.063 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.060+0000 7ff4dad9d700 1 -- 172.21.15.190:0/692211808 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc136580 con 0x7ff4dc0aa090 2020-04-02T23:48:39.063 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.061+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.063+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> v2:172.21.15.190:3300/0 conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.063+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.065+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.065+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4d40104d0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.065+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc09fc10 con 0x7ff4dc0aa090 2020-04-02T23:48:39.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.065+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc135a90 con 0x7ff4dc0aa090 2020-04-02T23:48:39.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.066+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4dc135ec0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.067+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.067+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.067+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4005c30 con 0x7ff4dc0aa090 2020-04-02T23:48:39.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.067+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4d4007150 con 0x7ff4dc0aa090 2020-04-02T23:48:39.089 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.086+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.089 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.086+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.086+0000 7ff4dad9d700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.086+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff4d40072b0 con 0x7ff4dc0aa090 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4cb7fe700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff4d4061c30 con 0x7ff4dc0aa090 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4cb7fe700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] conn(0x7ff4b8054a60 0x7ff4b8056eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.090 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 --> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4b8057490 con 0x7ff4b8054a60 2020-04-02T23:48:39.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4d4061f40 con 0x7ff4dc0aa090 2020-04-02T23:48:39.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4da59c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4da59c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4d0000fe0 tx=0x7ff4d0002700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4da59c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4d0000fe0 tx=0x7ff4d0002700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.092 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4da59c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7ff4d0000fe0 tx=0x7ff4d0002700).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.094 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.087+0000 7ff4d9d9b700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] conn(0x7ff4b8054a60 0x7ff4b8056eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.095 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.092+0000 7ff4d9d9b700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] conn(0x7ff4b8054a60 0x7ff4b8056eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.186 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.185+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== osd.4 v2:172.21.15.78:6802/25645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7ff4b8057490 con 0x7ff4b8054a60 2020-04-02T23:48:39.203 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.201+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 --> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4dc134780 con 0x7ff4b8054a60 2020-04-02T23:48:39.213 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.211+0000 7ff4cb7fe700 1 -- 172.21.15.190:0/692211808 <== osd.4 v2:172.21.15.78:6802/25645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4dc134780 con 0x7ff4b8054a60 2020-04-02T23:48:39.214 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] conn(0x7ff4b8054a60 msgr2=0x7ff4b8056eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6802/25645,v1:172.21.15.78:6803/25645] conn(0x7ff4b8054a60 0x7ff4b8056eb0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 msgr2=0x7ff4b804fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff4b804d970 0x7ff4b804fe80 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7ff4d0000fe0 tx=0x7ff4d0002700).stop 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 msgr2=0x7ff4dc137850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7ff4d40032b0 tx=0x7ff4d4007dc0).stop 2020-04-02T23:48:39.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4dad9d700 1 -- 172.21.15.190:0/692211808 reap_dead start 2020-04-02T23:48:39.216 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 shutdown_connections 2020-04-02T23:48:39.216 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 --2- 172.21.15.190:0/692211808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4dc0aa090 0x7ff4dc137850 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.216 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 >> 172.21.15.190:0/692211808 conn(0x7ff4dc063490 msgr2=0x7ff4dc06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.216 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 shutdown_connections 2020-04-02T23:48:39.216 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.212+0000 7ff4e0d3c700 1 -- 172.21.15.190:0/692211808 wait complete. 2020-04-02T23:48:39.226 INFO:teuthology.orchestra.run.smithi190.stdout:64424509448 2020-04-02T23:48:39.226 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:39.240 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-02T23:48:39.387 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.385+0000 7fd31f092700 1 Processor -- start 2020-04-02T23:48:39.388 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.385+0000 7fd31f092700 1 -- start start 2020-04-02T23:48:39.389 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd31809f5f0 0x7fd3180a8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.389 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 0x7fd3180aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.389 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3180abeb0 0x7fd318137540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180a67e0 con 0x7fd3180ab640 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180a6a80 con 0x7fd3180abeb0 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31f092700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180a6d20 con 0x7fd31809f5f0 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31ce2e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd31809f5f0 0x7fd3180a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd31d62f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3180abeb0 0x7fd318137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.386+0000 7fd30ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 0x7fd3180aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.390 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.387+0000 7fd30ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 0x7fd3180aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51652/0 (socket says 172.21.15.190:51652) 2020-04-02T23:48:39.391 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.387+0000 7fd30ffff700 1 -- 172.21.15.190:0/1156715570 learned_addr learned my addr 172.21.15.190:0/1156715570 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:39.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 -- 172.21.15.190:0/1156715570 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd31809f5f0 msgr2=0x7fd3180a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:39.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd31809f5f0 0x7fd3180a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 -- 172.21.15.190:0/1156715570 >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 msgr2=0x7fd3180aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:39.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 0x7fd3180aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.393 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 -- 172.21.15.190:0/1156715570 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180a71c0 con 0x7fd3180abeb0 2020-04-02T23:48:39.393 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.390+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> v2:172.21.15.190:3300/0 conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.396 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.392+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> v2:172.21.15.190:3300/0 conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.396 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.392+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).ready entity=mon.1 client_cookie=cb2b4af9e1e57e8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.401 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.401 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd30f7fe700 1 -- 172.21.15.190:0/1156715570 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd310011d70 con 0x7fd3180abeb0 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd30f7fe700 1 -- 172.21.15.190:0/1156715570 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000a160 con 0x7fd3180abeb0 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd30f7fe700 1 -- 172.21.15.190:0/1156715570 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31000a540 con 0x7fd3180abeb0 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd31f092700 1 -- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 msgr2=0x7fd318137540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.402 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.396+0000 7fd31f092700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).stop 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 -- 172.21.15.190:0/1156715570 shutdown_connections 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3180abeb0 0x7fd318137540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 --2- 172.21.15.190:0/1156715570 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd31809f5f0 0x7fd3180a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 --2- 172.21.15.190:0/1156715570 >> v2:172.21.15.78:3300/0 conn(0x7fd3180ab640 0x7fd3180aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 -- 172.21.15.190:0/1156715570 >> 172.21.15.190:0/1156715570 conn(0x7fd31805b3d0 msgr2=0x7fd31805b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.403 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 -- 172.21.15.190:0/1156715570 shutdown_connections 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.397+0000 7fd31f092700 1 -- 172.21.15.190:0/1156715570 wait complete. 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.398+0000 7fd31f092700 1 Processor -- start 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.398+0000 7fd31f092700 1 -- start start 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31f092700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd3180abeb0 0x7fd3181360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31f092700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180637b0 con 0x7fd3180ab640 2020-04-02T23:48:39.404 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31f092700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd318063a50 con 0x7fd31809f5f0 2020-04-02T23:48:39.405 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31f092700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318066c50 con 0x7fd3180abeb0 2020-04-02T23:48:39.405 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31ce2e700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd31809f5f0 0x7fd318148100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54006/0 (socket says 172.21.15.190:54006) 2020-04-02T23:48:39.405 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.399+0000 7fd31ce2e700 1 -- 172.21.15.190:0/1484009020 learned_addr learned my addr 172.21.15.190:0/1484009020 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:39.406 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.400+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> v2:172.21.15.78:3300/0 conn(0x7fd3180abeb0 0x7fd3181360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.406 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.402+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471202083 0 0) 0x7fd318063a50 con 0x7fd31809f5f0 2020-04-02T23:48:39.406 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.402+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f8002fe0 con 0x7fd31809f5f0 2020-04-02T23:48:39.407 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.404+0000 7fd31d62f700 1 -- 172.21.15.190:0/1484009020 >> v1:172.21.15.190:6789/0 conn(0x7fd31809f5f0 legacy=0x7fd318148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.407 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.404+0000 7fd31d62f700 1 -- 172.21.15.190:0/1484009020 >> v1:172.21.15.78:6789/0 conn(0x7fd3180ab640 legacy=0x7fd3181359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.407 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.404+0000 7fd31d62f700 1 -- 172.21.15.190:0/1484009020 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318063cf0 con 0x7fd3180abeb0 2020-04-02T23:48:39.407 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.406+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> v2:172.21.15.78:3300/0 conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.410 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.408+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> v2:172.21.15.78:3300/0 conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.410 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.408+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd310005a40 con 0x7fd3180abeb0 2020-04-02T23:48:39.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310005ba0 con 0x7fd3180abeb0 2020-04-02T23:48:39.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.412+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31813a270 con 0x7fd3180abeb0 2020-04-02T23:48:39.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.413+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd310007150 con 0x7fd3180abeb0 2020-04-02T23:48:39.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.413+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318148a50 con 0x7fd3180abeb0 2020-04-02T23:48:39.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.413+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd318063e80 con 0x7fd3180abeb0 2020-04-02T23:48:39.430 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.429+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.431 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.429+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd3100072b0 con 0x7fd3180abeb0 2020-04-02T23:48:39.431 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.429+0000 7fd30dffb700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.432 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.430+0000 7fd31ce2e700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.432 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.430+0000 7fd31ce2e700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd314007fe0 tx=0x7fd314009870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.432 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.430+0000 7fd31ce2e700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd314007fe0 tx=0x7fd314009870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.432 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.430+0000 7fd31ce2e700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fd314007fe0 tx=0x7fd314009870).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd31d62f700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd310040db0 con 0x7fd3180abeb0 2020-04-02T23:48:39.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd30dffb700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] conn(0x7fd2f8054a40 0x7fd2f8056e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 --> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2f8057470 con 0x7fd2f8054a40 2020-04-02T23:48:39.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.431+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd310061780 con 0x7fd3180abeb0 2020-04-02T23:48:39.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.432+0000 7fd30ffff700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] conn(0x7fd2f8054a40 0x7fd2f8056e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.434+0000 7fd30ffff700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] conn(0x7fd2f8054a40 0x7fd2f8056e90 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.529+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== osd.5 v2:172.21.15.78:6818/25698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fd2f8057470 con 0x7fd2f8054a40 2020-04-02T23:48:39.547 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.546+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 --> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3180635b0 con 0x7fd2f8054a40 2020-04-02T23:48:39.558 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd30dffb700 1 -- 172.21.15.190:0/1484009020 <== osd.5 v2:172.21.15.78:6818/25698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3180635b0 con 0x7fd2f8054a40 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] conn(0x7fd2f8054a40 msgr2=0x7fd2f8056e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6818/25698,v1:172.21.15.78:6819/25698] conn(0x7fd2f8054a40 0x7fd2f8056e90 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 msgr2=0x7fd2f804fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd2f804d970 0x7fd2f804fe80 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fd314007fe0 tx=0x7fd314009870).stop 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 msgr2=0x7fd3181360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fd3100032b0 tx=0x7fd310007dc0).stop 2020-04-02T23:48:39.559 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31d62f700 1 -- 172.21.15.190:0/1484009020 reap_dead start 2020-04-02T23:48:39.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 shutdown_connections 2020-04-02T23:48:39.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 --2- 172.21.15.190:0/1484009020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3180abeb0 0x7fd3181360f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 >> 172.21.15.190:0/1484009020 conn(0x7fd31805b3d0 msgr2=0x7fd31806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 shutdown_connections 2020-04-02T23:48:39.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.556+0000 7fd31f092700 1 -- 172.21.15.190:0/1484009020 wait complete. 2020-04-02T23:48:39.567 INFO:teuthology.orchestra.run.smithi190.stdout:68719476744 2020-04-02T23:48:39.568 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:39.582 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-02T23:48:39.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.734+0000 7f2d7a61a700 1 Processor -- start 2020-04-02T23:48:39.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.734+0000 7f2d7a61a700 1 -- start start 2020-04-02T23:48:39.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.735+0000 7f2d7a61a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d74136fa0 0x7f2d740a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.735+0000 7f2d7a61a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:39.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.735+0000 7f2d7a61a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d741373b0 con 0x7f2d740a3af0 2020-04-02T23:48:39.737 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.735+0000 7f2d7a61a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740a4ed0 con 0x7f2d74136fa0 2020-04-02T23:48:39.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.735+0000 7f2d7a61a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740a5110 con 0x7f2d740a8470 2020-04-02T23:48:39.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.736+0000 7f2d78bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.738 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.736+0000 7f2d6bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d74136fa0 0x7f2d740a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.736+0000 7f2d78bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46650/0 (socket says 172.21.15.190:46650) 2020-04-02T23:48:39.739 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.736+0000 7f2d78bb7700 1 -- 172.21.15.190:0/4184004657 learned_addr learned my addr 172.21.15.190:0/4184004657 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:39.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.739+0000 7f2d78bb7700 1 -- 172.21.15.190:0/4184004657 >> v2:172.21.15.78:3300/0 conn(0x7f2d74136fa0 msgr2=0x7f2d740a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:39.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.739+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> v2:172.21.15.78:3300/0 conn(0x7f2d74136fa0 0x7f2d740a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.739+0000 7f2d78bb7700 1 -- 172.21.15.190:0/4184004657 >> v1:172.21.15.78:6789/0 conn(0x7f2d740a3af0 legacy=0x7f2d74136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.739+0000 7f2d78bb7700 1 -- 172.21.15.190:0/4184004657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740a3650 con 0x7f2d740a8470 2020-04-02T23:48:39.741 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.739+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.741+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.743 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.741+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).ready entity=mon.2 client_cookie=4c37b66b8a75125a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d737fe700 1 -- 172.21.15.190:0/4184004657 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c00a160 con 0x7f2d740a8470 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d737fe700 1 -- 172.21.15.190:0/4184004657 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00a2c0 con 0x7f2d740a8470 2020-04-02T23:48:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d737fe700 1 -- 172.21.15.190:0/4184004657 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c00a6e0 con 0x7f2d740a8470 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d7a61a700 1 -- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 msgr2=0x7f2d74140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.745+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).stop 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 -- 172.21.15.190:0/4184004657 shutdown_connections 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/4184004657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d740a8470 0x7f2d74140bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/4184004657 >> v2:172.21.15.78:3300/0 conn(0x7f2d74136fa0 0x7f2d740a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 -- 172.21.15.190:0/4184004657 >> 172.21.15.190:0/4184004657 conn(0x7f2d7405b3d0 msgr2=0x7f2d7405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.749 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 -- 172.21.15.190:0/4184004657 shutdown_connections 2020-04-02T23:48:39.750 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 -- 172.21.15.190:0/4184004657 wait complete. 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 Processor -- start 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.746+0000 7f2d7a61a700 1 -- start start 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.747+0000 7f2d7a61a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d740a8470 0x7f2d740aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.747+0000 7f2d7a61a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.747+0000 7f2d7a61a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740aa670 con 0x7f2d740a3af0 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.747+0000 7f2d7a61a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740aa910 con 0x7f2d740a8470 2020-04-02T23:48:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.747+0000 7f2d7a61a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741470d0 con 0x7f2d74136fa0 2020-04-02T23:48:39.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.748+0000 7f2d78bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.748+0000 7f2d6bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d740a8470 0x7f2d740aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.748+0000 7f2d78bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46656/0 (socket says 172.21.15.190:46656) 2020-04-02T23:48:39.752 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.748+0000 7f2d78bb7700 1 -- 172.21.15.190:0/1302118003 learned_addr learned my addr 172.21.15.190:0/1302118003 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:39.754 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.752+0000 7f2d78bb7700 1 -- 172.21.15.190:0/1302118003 >> v2:172.21.15.78:3300/0 conn(0x7f2d740a8470 msgr2=0x7f2d740aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.754 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.752+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> v2:172.21.15.78:3300/0 conn(0x7f2d740a8470 0x7f2d740aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.754 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.752+0000 7f2d78bb7700 1 -- 172.21.15.190:0/1302118003 >> v1:172.21.15.78:6789/0 conn(0x7f2d740a3af0 legacy=0x7f2d74147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.754 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.752+0000 7f2d78bb7700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740ac2b0 con 0x7f2d74136fa0 2020-04-02T23:48:39.754 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.752+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.755+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.755+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c0114c0 con 0x7f2d74136fa0 2020-04-02T23:48:39.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c011620 con 0x7f2d74136fa0 2020-04-02T23:48:39.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d741353a0 con 0x7f2d74136fa0 2020-04-02T23:48:39.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c005c30 con 0x7f2d74136fa0 2020-04-02T23:48:39.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.759+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d74147e40 con 0x7f2d74136fa0 2020-04-02T23:48:39.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.760+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d74056ec0 con 0x7f2d74136fa0 2020-04-02T23:48:39.775 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.773+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.773+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2d6c010740 con 0x7f2d74136fa0 2020-04-02T23:48:39.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.773+0000 7f2d71ffb700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.774+0000 7f2d73fff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.774+0000 7f2d73fff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d74066400 tx=0x7f2d64002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.774+0000 7f2d73fff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d74066400 tx=0x7f2d64002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.774+0000 7f2d73fff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2d74066400 tx=0x7f2d64002520).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.776+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.776+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2d6c040fc0 con 0x7f2d74136fa0 2020-04-02T23:48:39.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.776+0000 7f2d71ffb700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] conn(0x7f2d58054790 0x7f2d58056be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:39.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.776+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d580571c0 con 0x7f2d58054790 2020-04-02T23:48:39.779 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.777+0000 7f2d6bfff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] conn(0x7f2d58054790 0x7f2d58056be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:39.780 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.778+0000 7f2d78bb7700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:39.780 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.778+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d6c061990 con 0x7f2d74136fa0 2020-04-02T23:48:39.782 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.780+0000 7f2d6bfff700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] conn(0x7f2d58054790 0x7f2d58056be0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:39.878 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.877+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== osd.6 v2:172.21.15.78:6810/25716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f2d580571c0 con 0x7f2d58054790 2020-04-02T23:48:39.895 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.893+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 --> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d740a76d0 con 0x7f2d58054790 2020-04-02T23:48:39.904 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d71ffb700 1 -- 172.21.15.190:0/1302118003 <== osd.6 v2:172.21.15.78:6810/25716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d740a76d0 con 0x7f2d58054790 2020-04-02T23:48:39.906 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] conn(0x7f2d58054790 msgr2=0x7f2d58056be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6810/25716,v1:172.21.15.78:6811/25716] conn(0x7f2d58054790 0x7f2d58056be0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 msgr2=0x7f2d5804fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f2d5804d5a0 0x7f2d5804fab0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2d74066400 tx=0x7f2d64002520).stop 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 msgr2=0x7f2d7412d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 --2- 172.21.15.190:0/1302118003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d74136fa0 0x7f2d7412d800 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2d6c0032b0 tx=0x7f2d6c007dc0).stop 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d78bb7700 1 -- 172.21.15.190:0/1302118003 reap_dead start 2020-04-02T23:48:39.907 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 shutdown_connections 2020-04-02T23:48:39.908 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 >> 172.21.15.190:0/1302118003 conn(0x7f2d7405b3d0 msgr2=0x7f2d7406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:39.908 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 shutdown_connections 2020-04-02T23:48:39.908 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:39.903+0000 7f2d7a61a700 1 -- 172.21.15.190:0/1302118003 wait complete. 2020-04-02T23:48:39.914 INFO:teuthology.orchestra.run.smithi190.stdout:64424509448 2020-04-02T23:48:39.915 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:39.928 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-02T23:48:40.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.071+0000 7fb600993700 1 Processor -- start 2020-04-02T23:48:40.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.071+0000 7fb600993700 1 -- start start 2020-04-02T23:48:40.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.072+0000 7fb600993700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc0a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:40.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.072+0000 7fb600993700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5fc136890 0x7fb5fc136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:40.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.072+0000 7fb600993700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc0a87f0 con 0x7fb5fc1398b0 2020-04-02T23:48:40.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.072+0000 7fb600993700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0a8a90 con 0x7fb5fc136890 2020-04-02T23:48:40.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.072+0000 7fb600993700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0a8d30 con 0x7fb5fc0a4f90 2020-04-02T23:48:40.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.073+0000 7fb5fad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5fc136890 0x7fb5fc136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.073+0000 7fb5fa59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc0a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.073+0000 7fb5f9d9b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb5fc1398b0 0x7fb5fc139cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54030/0 (socket says 172.21.15.190:54030) 2020-04-02T23:48:40.076 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.073+0000 7fb5f9d9b700 1 -- 172.21.15.190:0/2037607465 learned_addr learned my addr 172.21.15.190:0/2037607465 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:40.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.076+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2037607465 >> v2:172.21.15.190:3300/0 conn(0x7fb5fc0a4f90 msgr2=0x7fb5fc0a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:40.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.076+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> v2:172.21.15.190:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc0a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:40.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.076+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2037607465 >> v1:172.21.15.190:6789/0 conn(0x7fb5fc1398b0 legacy=0x7fb5fc139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.076+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2037607465 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0a8470 con 0x7fb5fc136890 2020-04-02T23:48:40.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.076+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> v2:172.21.15.78:3300/0 conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.077+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> v2:172.21.15.78:3300/0 conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.077+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).ready entity=mon.0 client_cookie=ab63a50c08459676 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.081 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.079+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.081 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.079+0000 7fb5f959a700 1 -- 172.21.15.190:0/2037607465 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5f4013e40 con 0x7fb5fc136890 2020-04-02T23:48:40.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb5f959a700 1 -- 172.21.15.190:0/2037607465 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400a350 con 0x7fb5fc136890 2020-04-02T23:48:40.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb5f959a700 1 -- 172.21.15.190:0/2037607465 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5f400a730 con 0x7fb5fc136890 2020-04-02T23:48:40.084 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb600993700 1 -- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 msgr2=0x7fb5fc136ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.085 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.082+0000 7fb600993700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).stop 2020-04-02T23:48:40.085 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 -- 172.21.15.190:0/2037607465 shutdown_connections 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 --2- 172.21.15.190:0/2037607465 >> v2:172.21.15.190:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc0a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 --2- 172.21.15.190:0/2037607465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5fc136890 0x7fb5fc136ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 -- 172.21.15.190:0/2037607465 >> 172.21.15.190:0/2037607465 conn(0x7fb5fc05b3d0 msgr2=0x7fb5fc05b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 -- 172.21.15.190:0/2037607465 shutdown_connections 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.083+0000 7fb600993700 1 -- 172.21.15.190:0/2037607465 wait complete. 2020-04-02T23:48:40.086 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 Processor -- start 2020-04-02T23:48:40.087 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 -- start start 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc066730 con 0x7fb5fc136890 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc14a590 con 0x7fb5fc0a4f90 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.084+0000 7fb600993700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc132360 con 0x7fb5fc1398b0 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.085+0000 7fb5fad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.088 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.085+0000 7fb5fa59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.089 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.085+0000 7fb5fad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46672/0 (socket says 172.21.15.190:46672) 2020-04-02T23:48:40.089 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.085+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2883479055 learned_addr learned my addr 172.21.15.190:0/2883479055 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:40.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.089+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2883479055 >> v2:172.21.15.78:3300/0 conn(0x7fb5fc0a4f90 msgr2=0x7fb5fc130f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.091 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.089+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> v2:172.21.15.78:3300/0 conn(0x7fb5fc0a4f90 0x7fb5fc130f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.092 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.089+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2883479055 >> v1:172.21.15.78:6789/0 conn(0x7fb5fc136890 legacy=0x7fb5fc131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.092 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.089+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc1307d0 con 0x7fb5fc1398b0 2020-04-02T23:48:40.092 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.090+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.094 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.092+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.094 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.092+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.095+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.095+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5f4015360 con 0x7fb5fc1398b0 2020-04-02T23:48:40.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.095+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc130a70 con 0x7fb5fc1398b0 2020-04-02T23:48:40.097 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.095+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc09f8a0 con 0x7fb5fc1398b0 2020-04-02T23:48:40.098 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.096+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5fc130c00 con 0x7fb5fc1398b0 2020-04-02T23:48:40.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc130c00 con 0x7fb5fc1398b0 2020-04-02T23:48:40.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5f4007f50 con 0x7fb5fc1398b0 2020-04-02T23:48:40.115 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.116 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb5f40156b0 con 0x7fb5fc1398b0 2020-04-02T23:48:40.117 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.113+0000 7fb5eb7fe700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.117 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.114+0000 7fb5fa59c700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.117 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.114+0000 7fb5fa59c700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb5f0002f30 tx=0x7fb5f000d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.117 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.114+0000 7fb5fa59c700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb5f0002f30 tx=0x7fb5f000d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.114+0000 7fb5fa59c700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fb5f0002f30 tx=0x7fb5f000d8b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb5f4040750 con 0x7fb5fc1398b0 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5fad9d700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5eb7fe700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] conn(0x7fb5d8054700 0x7fb5d8056b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5d8057130 con 0x7fb5d8054700 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f40610c0 con 0x7fb5fc1398b0 2020-04-02T23:48:40.118 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.115+0000 7fb5f9d9b700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] conn(0x7fb5d8054700 0x7fb5d8056b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.121 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.118+0000 7fb5f9d9b700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] conn(0x7fb5d8054700 0x7fb5d8056b50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.215 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.213+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== osd.7 v2:172.21.15.78:6826/25729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fb5d8057130 con 0x7fb5d8054700 2020-04-02T23:48:40.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.231+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 --> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5fc056ec0 con 0x7fb5d8054700 2020-04-02T23:48:40.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb5eb7fe700 1 -- 172.21.15.190:0/2883479055 <== osd.7 v2:172.21.15.78:6826/25729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5fc056ec0 con 0x7fb5d8054700 2020-04-02T23:48:40.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] conn(0x7fb5d8054700 msgr2=0x7fb5d8056b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6826/25729,v1:172.21.15.78:6827/25729] conn(0x7fb5d8054700 0x7fb5d8056b50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 msgr2=0x7fb5d804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fb5d804d510 0x7fb5d804fa20 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fb5f0002f30 tx=0x7fb5f000d8b0).stop 2020-04-02T23:48:40.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 msgr2=0x7fb5fc131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 --2- 172.21.15.190:0/2883479055 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5fc1398b0 0x7fb5fc131370 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fb5f40032b0 tx=0x7fb5f4007dc0).stop 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb5fad9d700 1 -- 172.21.15.190:0/2883479055 reap_dead start 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.245+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 shutdown_connections 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.246+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 >> 172.21.15.190:0/2883479055 conn(0x7fb5fc05b3d0 msgr2=0x7fb5fc136ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.246+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 shutdown_connections 2020-04-02T23:48:40.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.246+0000 7fb600993700 1 -- 172.21.15.190:0/2883479055 wait complete. 2020-04-02T23:48:40.258 INFO:teuthology.orchestra.run.smithi190.stdout:64424509447 2020-04-02T23:48:40.258 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:40.271 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-02T23:48:40.421 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.416+0000 7f2128315700 1 Processor -- start 2020-04-02T23:48:40.421 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.416+0000 7f2128315700 1 -- start start 2020-04-02T23:48:40.421 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.417+0000 7f2128315700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:40.421 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.417+0000 7f2128315700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21201373b0 con 0x7f21200a8470 2020-04-02T23:48:40.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.417+0000 7f2128315700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200a4ed0 con 0x7f2120136fa0 2020-04-02T23:48:40.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.417+0000 7f2128315700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200a5110 con 0x7f21200a3af0 2020-04-02T23:48:40.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.418+0000 7f21268b2700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2120136fa0 0x7f2120140bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54044/0 (socket says 172.21.15.190:54044) 2020-04-02T23:48:40.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.418+0000 7f21268b2700 1 -- 172.21.15.190:0/2555223093 learned_addr learned my addr 172.21.15.190:0/2555223093 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:40.422 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.418+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.420+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052806465 0 0) 0x7f211c0010d0 con 0x7f2120136fa0 2020-04-02T23:48:40.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.420+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2108003230 con 0x7f2120136fa0 2020-04-02T23:48:40.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.420+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210753217 0 0) 0x7f21201373b0 con 0x7f21200a8470 2020-04-02T23:48:40.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.420+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c0010d0 con 0x7f21200a8470 2020-04-02T23:48:40.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.421+0000 7f21260b1700 1 -- 172.21.15.190:0/2555223093 >> v1:172.21.15.190:6789/0 conn(0x7f2120136fa0 legacy=0x7f2120140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.421+0000 7f21260b1700 1 -- 172.21.15.190:0/2555223093 >> v1:172.21.15.78:6789/0 conn(0x7f21200a8470 legacy=0x7f2120136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.421+0000 7f21260b1700 1 -- 172.21.15.190:0/2555223093 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200a3650 con 0x7f21200a3af0 2020-04-02T23:48:40.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.421+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21180032b0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.422+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21180032b0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.422+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f2118008c60).ready entity=mon.2 client_cookie=2dd0cdaa179a236f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.432 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21260b1700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f2118008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118011db0 con 0x7f21200a3af0 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800a160 con 0x7f21200a3af0 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f21250af700 1 -- 172.21.15.190:0/2555223093 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f211800a580 con 0x7f21200a3af0 2020-04-02T23:48:40.433 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 -- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 msgr2=0x7f21200a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f2118008c60).stop 2020-04-02T23:48:40.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 -- 172.21.15.190:0/2555223093 shutdown_connections 2020-04-02T23:48:40.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 --2- 172.21.15.190:0/2555223093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21200a3af0 0x7f21200a4a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 -- 172.21.15.190:0/2555223093 >> 172.21.15.190:0/2555223093 conn(0x7f212005b3d0 msgr2=0x7f212005b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:40.434 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 -- 172.21.15.190:0/2555223093 shutdown_connections 2020-04-02T23:48:40.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.430+0000 7f2128315700 1 -- 172.21.15.190:0/2555223093 wait complete. 2020-04-02T23:48:40.435 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.431+0000 7f2128315700 1 Processor -- start 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.431+0000 7f2128315700 1 -- start start 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f2128315700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f21200a3af0 0x7f2120063e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f2128315700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2120135290 con 0x7f2120136fa0 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f2128315700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2120062610 con 0x7f21200a8470 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f2128315700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200628b0 con 0x7f21200a3af0 2020-04-02T23:48:40.436 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f21260b1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f21200a3af0 0x7f2120063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f21268b2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2120136fa0 0x7f2120143e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36448/0 (socket says 172.21.15.190:36448) 2020-04-02T23:48:40.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.432+0000 7f21268b2700 1 -- 172.21.15.190:0/1906922199 learned_addr learned my addr 172.21.15.190:0/1906922199 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:40.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.435+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448466787 0 0) 0x7f2120135290 con 0x7f2120136fa0 2020-04-02T23:48:40.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.435+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2100002fe0 con 0x7f2120136fa0 2020-04-02T23:48:40.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.437+0000 7f21260b1700 1 -- 172.21.15.190:0/1906922199 >> v1:172.21.15.190:6789/0 conn(0x7f21200a8470 legacy=0x7f2120066940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.437+0000 7f21260b1700 1 -- 172.21.15.190:0/1906922199 >> v1:172.21.15.78:6789/0 conn(0x7f2120136fa0 legacy=0x7f2120143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.437+0000 7f21260b1700 1 -- 172.21.15.190:0/1906922199 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120062b50 con 0x7f21200a3af0 2020-04-02T23:48:40.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.437+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> v2:172.21.15.190:3300/0 conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.441+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> v2:172.21.15.190:3300/0 conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.443 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.441+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.447 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118005c30 con 0x7f21200a3af0 2020-04-02T23:48:40.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118005d90 con 0x7f21200a3af0 2020-04-02T23:48:40.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2120062300 con 0x7f21200a3af0 2020-04-02T23:48:40.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118007340 con 0x7f21200a3af0 2020-04-02T23:48:40.448 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.445+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2120061f70 con 0x7f21200a3af0 2020-04-02T23:48:40.449 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.446+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120143cf0 con 0x7f21200a3af0 2020-04-02T23:48:40.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.633+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.634+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.634+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f21180075b0 con 0x7f21200a3af0 2020-04-02T23:48:40.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.634+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.634+0000 7f210f7fe700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.634+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2118061b10 con 0x7f21200a3af0 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.635+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2118061f10 con 0x7f21200a3af0 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.635+0000 7f21258b0700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.635+0000 7f21258b0700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21200a4cb0 tx=0x7f2110002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.635+0000 7f21258b0700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21200a4cb0 tx=0x7f2110002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.635+0000 7f21258b0700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f21200a4cb0 tx=0x7f2110002520).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.772+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2120062d50 con 0x7f21200a3af0 2020-04-02T23:48:40.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.782+0000 7f21260b1700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.782+0000 7f210f7fe700 1 -- 172.21.15.190:0/1906922199 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f211803d2f0 con 0x7f21200a3af0 2020-04-02T23:48:40.784 INFO:teuthology.orchestra.run.smithi190.stdout:64424509448 2020-04-02T23:48:40.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 msgr2=0x7f210004fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f21200a4cb0 tx=0x7f2110002520).stop 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 msgr2=0x7f2120063e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f21180032b0 tx=0x7f21200a3510).stop 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 shutdown_connections 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f210004d8f0 0x7f210004fe00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.786 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 --2- 172.21.15.190:0/1906922199 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21200a3af0 0x7f2120063e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 >> 172.21.15.190:0/1906922199 conn(0x7f212005b3d0 msgr2=0x7f2120136640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:40.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 shutdown_connections 2020-04-02T23:48:40.787 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.783+0000 7f2128315700 1 -- 172.21.15.190:0/1906922199 wait complete. 2020-04-02T23:48:40.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.0 2020-04-02T23:48:40.796 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:40.810 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-02T23:48:40.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.957+0000 7f1638b87700 1 Processor -- start 2020-04-02T23:48:40.960 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.957+0000 7f1638b87700 1 -- start start 2020-04-02T23:48:40.960 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.958+0000 7f1638b87700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16340666f0 0x7f1634066b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:40.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.958+0000 7f1638b87700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f163413cdc0 0x7f163413d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:40.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.958+0000 7f1638b87700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340679a0 con 0x7f163409e4b0 2020-04-02T23:48:40.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.958+0000 7f1638b87700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1634067c40 con 0x7f16340666f0 2020-04-02T23:48:40.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.958+0000 7f1638b87700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1634067380 con 0x7f163413cdc0 2020-04-02T23:48:40.962 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.959+0000 7f1631d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f163413cdc0 0x7f163413d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.962 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.959+0000 7f1631d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f163413cdc0 0x7f163413d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60834/0 (socket says 172.21.15.190:60834) 2020-04-02T23:48:40.962 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.959+0000 7f1631d9b700 1 -- 172.21.15.190:0/2798384889 learned_addr learned my addr 172.21.15.190:0/2798384889 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:40.962 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.959+0000 7f163259c700 1 --2- 172.21.15.190:0/2798384889 >> v2:172.21.15.78:3300/0 conn(0x7f16340666f0 0x7f1634066b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.964 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.962+0000 7f1631d9b700 1 -- 172.21.15.190:0/2798384889 >> v2:172.21.15.78:3300/0 conn(0x7f16340666f0 msgr2=0x7f1634066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:40.964 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.962+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> v2:172.21.15.78:3300/0 conn(0x7f16340666f0 0x7f1634066b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:40.964 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.962+0000 7f1631d9b700 1 -- 172.21.15.190:0/2798384889 >> v1:172.21.15.78:6789/0 conn(0x7f163409e4b0 legacy=0x7f163409e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.962+0000 7f1631d9b700 1 -- 172.21.15.190:0/2798384889 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163413d630 con 0x7f163413cdc0 2020-04-02T23:48:40.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.962+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> v2:172.21.15.190:3300/0 conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f161c002f30 tx=0x7f161c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.964+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> v2:172.21.15.190:3300/0 conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f161c002f30 tx=0x7f161c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.964+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f161c002f30 tx=0x7f161c007a40).ready entity=mon.1 client_cookie=274fac952258cdb1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.968+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f161c002f30 tx=0x7f161c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.968+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f161c002f30 tx=0x7f161c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.968+0000 7f1631d9b700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f161c002f30 tx=0x7f161c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.968+0000 7f163159a700 1 -- 172.21.15.190:0/2798384889 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161c011670 con 0x7f163413cdc0 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.968+0000 7f163159a700 1 -- 172.21.15.190:0/2798384889 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c0117d0 con 0x7f163413cdc0 2020-04-02T23:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f163159a700 1 -- 172.21.15.190:0/2798384889 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161c011b70 con 0x7f163413cdc0 2020-04-02T23:48:40.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 -- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 msgr2=0x7f163413d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.972 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f161c002f30 tx=0x7f161c007a40).stop 2020-04-02T23:48:40.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 -- 172.21.15.190:0/2798384889 shutdown_connections 2020-04-02T23:48:40.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 --2- 172.21.15.190:0/2798384889 >> v2:172.21.15.78:3300/0 conn(0x7f16340666f0 0x7f1634066b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 --2- 172.21.15.190:0/2798384889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f163413cdc0 0x7f163413d1d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 -- 172.21.15.190:0/2798384889 >> 172.21.15.190:0/2798384889 conn(0x7f163405b3d0 msgr2=0x7f163405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 -- 172.21.15.190:0/2798384889 shutdown_connections 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.969+0000 7f1638b87700 1 -- 172.21.15.190:0/2798384889 wait complete. 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.970+0000 7f1638b87700 1 Processor -- start 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.970+0000 7f1638b87700 1 -- start start 2020-04-02T23:48:40.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f1638b87700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f163413cdc0 0x7f16341390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f1638b87700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340a4a10 con 0x7f163409e4b0 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f1638b87700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1634137c20 con 0x7f16340666f0 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f1638b87700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1634137ec0 con 0x7f163413cdc0 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f163259c700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f16340666f0 0x7f16340a4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54058/0 (socket says 172.21.15.190:54058) 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.971+0000 7f163259c700 1 -- 172.21.15.190:0/2935392719 learned_addr learned my addr 172.21.15.190:0/2935392719 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:40.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.972+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> v2:172.21.15.78:3300/0 conn(0x7f163413cdc0 0x7f16341390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:40.976 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.974+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974759725 0 0) 0x7f1634137c20 con 0x7f16340666f0 2020-04-02T23:48:40.976 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.974+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1618002fe0 con 0x7f16340666f0 2020-04-02T23:48:40.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.976+0000 7f1632d9d700 1 -- 172.21.15.190:0/2935392719 >> v1:172.21.15.190:6789/0 conn(0x7f16340666f0 legacy=0x7f16340a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.976+0000 7f1632d9d700 1 -- 172.21.15.190:0/2935392719 >> v1:172.21.15.78:6789/0 conn(0x7f163409e4b0 legacy=0x7f1634146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:40.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.976+0000 7f1632d9d700 1 -- 172.21.15.190:0/2935392719 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634138360 con 0x7f163413cdc0 2020-04-02T23:48:40.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.976+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> v2:172.21.15.78:3300/0 conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.978+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> v2:172.21.15.78:3300/0 conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.978+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:40.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.982+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.984 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.982+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c0101c0 con 0x7f163413cdc0 2020-04-02T23:48:40.985 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.982+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16340a31e0 con 0x7f163413cdc0 2020-04-02T23:48:40.985 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.982+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1634147560 con 0x7f163413cdc0 2020-04-02T23:48:40.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.983+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1634056ec0 con 0x7f163413cdc0 2020-04-02T23:48:40.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.983+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.983+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:40.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.983+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c010320 con 0x7f163413cdc0 2020-04-02T23:48:40.986 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:40.983+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c010740 con 0x7f163413cdc0 2020-04-02T23:48:41.162 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.160+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.161+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f162c013060 con 0x7f163413cdc0 2020-04-02T23:48:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.161+0000 7f162b7fe700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.161+0000 7f163259c700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.162+0000 7f163259c700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1624002f30 tx=0x7f16240090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.162+0000 7f163259c700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1624002f30 tx=0x7f16240090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.162+0000 7f163259c700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f1624002f30 tx=0x7f16240090b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.164+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.164+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f162c0403c0 con 0x7f163413cdc0 2020-04-02T23:48:41.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.172+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.172+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f162c03c760 con 0x7f163413cdc0 2020-04-02T23:48:41.313 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.311+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1634138000 con 0x7f163413cdc0 2020-04-02T23:48:41.334 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.332+0000 7f1632d9d700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.334 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.332+0000 7f162b7fe700 1 -- 172.21.15.190:0/2935392719 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f162c03fd80 con 0x7f163413cdc0 2020-04-02T23:48:41.335 INFO:teuthology.orchestra.run.smithi190.stdout:64424509449 2020-04-02T23:48:41.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 msgr2=0x7f161804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.336 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f1624002f30 tx=0x7f16240090b0).stop 2020-04-02T23:48:41.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 msgr2=0x7f16341390e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f16340a73b0 tx=0x7f162c0021b0).stop 2020-04-02T23:48:41.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 shutdown_connections 2020-04-02T23:48:41.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f161804d850 0x7f161804fd60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.337 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 --2- 172.21.15.190:0/2935392719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f163413cdc0 0x7f16341390e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.333+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 >> 172.21.15.190:0/2935392719 conn(0x7f163405b3d0 msgr2=0x7f1634139ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:41.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.334+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 shutdown_connections 2020-04-02T23:48:41.338 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.334+0000 7f1638b87700 1 -- 172.21.15.190:0/2935392719 wait complete. 2020-04-02T23:48:41.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.1 2020-04-02T23:48:41.346 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:41.359 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-02T23:48:41.507 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.505+0000 7f9fd990b700 1 Processor -- start 2020-04-02T23:48:41.507 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.505+0000 7f9fd990b700 1 -- start start 2020-04-02T23:48:41.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd990b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fd413cbd0 0x7f9fd413cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:41.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd990b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fd4133360 0x7f9fd4133770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:41.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd990b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd40a7dd0 con 0x7f9fd406b300 2020-04-02T23:48:41.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd990b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40a8020 con 0x7f9fd4133360 2020-04-02T23:48:41.508 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd990b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40a82c0 con 0x7f9fd413cbd0 2020-04-02T23:48:41.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd27fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fd413cbd0 0x7f9fd413cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd27fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fd413cbd0 0x7f9fd413cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60848/0 (socket says 172.21.15.190:60848) 2020-04-02T23:48:41.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd27fc700 1 -- 172.21.15.190:0/3774818003 learned_addr learned my addr 172.21.15.190:0/3774818003 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:41.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.506+0000 7f9fd37fe700 1 --2- 172.21.15.190:0/3774818003 >> v2:172.21.15.78:3300/0 conn(0x7f9fd4133360 0x7f9fd4133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.509+0000 7f9fd27fc700 1 -- 172.21.15.190:0/3774818003 >> v2:172.21.15.78:3300/0 conn(0x7f9fd4133360 msgr2=0x7f9fd4133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:41.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.509+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> v2:172.21.15.78:3300/0 conn(0x7f9fd4133360 0x7f9fd4133770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:41.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.509+0000 7f9fd27fc700 1 -- 172.21.15.190:0/3774818003 >> v1:172.21.15.78:6789/0 conn(0x7f9fd406b300 legacy=0x7f9fd40a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:41.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.509+0000 7f9fd27fc700 1 -- 172.21.15.190:0/3774818003 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40a7aa0 con 0x7f9fd413cbd0 2020-04-02T23:48:41.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.509+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> v2:172.21.15.190:3300/0 conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.513 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.511+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> v2:172.21.15.190:3300/0 conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.513 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.511+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).ready entity=mon.1 client_cookie=87284b82b04bf167 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd1ffb700 1 -- 172.21.15.190:0/3774818003 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc011630 con 0x7f9fd413cbd0 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd1ffb700 1 -- 172.21.15.190:0/3774818003 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc011790 con 0x7f9fd413cbd0 2020-04-02T23:48:41.518 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd1ffb700 1 -- 172.21.15.190:0/3774818003 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc011b70 con 0x7f9fd413cbd0 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd990b700 1 -- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 msgr2=0x7f9fd413cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.515+0000 7f9fd990b700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).stop 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 -- 172.21.15.190:0/3774818003 shutdown_connections 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 --2- 172.21.15.190:0/3774818003 >> v2:172.21.15.78:3300/0 conn(0x7f9fd4133360 0x7f9fd4133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 --2- 172.21.15.190:0/3774818003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fd413cbd0 0x7f9fd413cfe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 -- 172.21.15.190:0/3774818003 >> 172.21.15.190:0/3774818003 conn(0x7f9fd40ac9a0 msgr2=0x7f9fd40a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 -- 172.21.15.190:0/3774818003 shutdown_connections 2020-04-02T23:48:41.519 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.516+0000 7f9fd990b700 1 -- 172.21.15.190:0/3774818003 wait complete. 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 Processor -- start 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 -- start start 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fd406b300 0x7f9fd40a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fd4133360 0x7f9fd40a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fd413cbd0 0x7f9fd40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd414a650 con 0x7f9fd406b300 2020-04-02T23:48:41.521 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd414a8f0 con 0x7f9fd4133360 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.517+0000 7f9fd990b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd414ab90 con 0x7f9fd413cbd0 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.518+0000 7f9fd2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fd406b300 0x7f9fd40a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.518+0000 7f9fd27fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fd4133360 0x7f9fd40a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.518+0000 7f9fd2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fd406b300 0x7f9fd40a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51722/0 (socket says 172.21.15.190:51722) 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.518+0000 7f9fd37fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fd413cbd0 0x7f9fd40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.518+0000 7f9fd2ffd700 1 -- 172.21.15.190:0/632953097 learned_addr learned my addr 172.21.15.190:0/632953097 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:41.524 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 -- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fd413cbd0 msgr2=0x7f9fd40a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.524 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fd413cbd0 0x7f9fd40a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.524 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 -- 172.21.15.190:0/632953097 >> v2:172.21.15.190:3300/0 conn(0x7f9fd4133360 msgr2=0x7f9fd40a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.524 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> v2:172.21.15.190:3300/0 conn(0x7f9fd4133360 0x7f9fd40a3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.524 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 -- 172.21.15.190:0/632953097 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd414a340 con 0x7f9fd406b300 2020-04-02T23:48:41.525 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.522+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> v2:172.21.15.78:3300/0 conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.524+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> v2:172.21.15.78:3300/0 conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.524+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:41.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fcc012260 con 0x7f9fd406b300 2020-04-02T23:48:41.531 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0123c0 con 0x7f9fd406b300 2020-04-02T23:48:41.532 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd40a4bd0 con 0x7f9fd406b300 2020-04-02T23:48:41.532 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fcc0127a0 con 0x7f9fd406b300 2020-04-02T23:48:41.532 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.529+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd40a0270 con 0x7f9fd406b300 2020-04-02T23:48:41.532 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.530+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd4056ec0 con 0x7f9fd406b300 2020-04-02T23:48:41.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9fcc013060 con 0x7f9fd406b300 2020-04-02T23:48:41.652 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fcbfff700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:41.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:41.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.650+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.651+0000 7f9fd27fc700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:41.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.659+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.659+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9fcc040ad0 con 0x7f9fd406b300 2020-04-02T23:48:41.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.734+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.736 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.734+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9fcc03ce70 con 0x7f9fd406b300 2020-04-02T23:48:41.879 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.877+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fd413c9b0 con 0x7f9fd406b300 2020-04-02T23:48:41.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.881+0000 7f9fd2ffd700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:41.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.881+0000 7f9fcbfff700 1 -- 172.21.15.190:0/632953097 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fcc040490 con 0x7f9fd406b300 2020-04-02T23:48:41.883 INFO:teuthology.orchestra.run.smithi190.stdout:64424509447 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 msgr2=0x7f9fb804fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f9fd409fa50 tx=0x7f9fbc007a40).stop 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 msgr2=0x7f9fd40a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f9fcc0022d0 tx=0x7f9fcc010c70).stop 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 shutdown_connections 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f9fb804d5d0 0x7f9fb804fae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fd413cbd0 0x7f9fd40a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd406b300 0x7f9fd40a4770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 --2- 172.21.15.190:0/632953097 >> v2:172.21.15.190:3300/0 conn(0x7f9fd4133360 0x7f9fd40a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:41.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 >> 172.21.15.190:0/632953097 conn(0x7f9fd40ac9a0 msgr2=0x7f9fd406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:41.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 shutdown_connections 2020-04-02T23:48:41.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:41.882+0000 7f9fd990b700 1 -- 172.21.15.190:0/632953097 wait complete. 2020-04-02T23:48:41.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2020-04-02T23:48:41.894 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:41.910 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-02T23:48:42.055 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.053+0000 7f7cba54f700 1 Processor -- start 2020-04-02T23:48:42.055 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.053+0000 7f7cba54f700 1 -- start start 2020-04-02T23:48:42.056 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cba54f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cba54f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb41373b0 con 0x7f7cb40a8470 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cba54f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40a4ed0 con 0x7f7cb40a3af0 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cba54f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40a5110 con 0x7f7cb4136fa0 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cb3fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7cb40a3af0 0x7f7cb4136890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54080/0 (socket says 172.21.15.190:54080) 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cb3fff700 1 -- 172.21.15.190:0/1259739238 learned_addr learned my addr 172.21.15.190:0/1259739238 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:42.057 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.054+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.057+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563450670 0 0) 0x7f7cb41373b0 con 0x7f7cb40a8470 2020-04-02T23:48:42.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.057+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c94003230 con 0x7f7cb40a8470 2020-04-02T23:48:42.059 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.057+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977382863 0 0) 0x7f7ca40010d0 con 0x7f7cb40a3af0 2020-04-02T23:48:42.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.057+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb41373b0 con 0x7f7cb40a3af0 2020-04-02T23:48:42.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.058+0000 7f7cabfff700 1 -- 172.21.15.190:0/1259739238 >> v1:172.21.15.190:6789/0 conn(0x7f7cb40a3af0 legacy=0x7f7cb4136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.060 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.058+0000 7f7cabfff700 1 -- 172.21.15.190:0/1259739238 >> v1:172.21.15.78:6789/0 conn(0x7f7cb40a8470 legacy=0x7f7cb4140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.058+0000 7f7cabfff700 1 -- 172.21.15.190:0/1259739238 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb40a3650 con 0x7f7cb4136fa0 2020-04-02T23:48:42.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.058+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.061 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.060+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.062 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.060+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).ready entity=mon.2 client_cookie=5748886bd8c81359 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.064 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.062+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.064 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.062+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9c008e40 con 0x7f7cb4136fa0 2020-04-02T23:48:42.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.063+0000 7f7cabfff700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.065 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.063+0000 7f7cb37fe700 1 -- 172.21.15.190:0/1259739238 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c011540 con 0x7f7cb4136fa0 2020-04-02T23:48:42.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.063+0000 7f7cba54f700 1 -- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 msgr2=0x7f7cb40a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.063+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f7c9c002f30 tx=0x7f7c9c0088e0).stop 2020-04-02T23:48:42.066 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.064+0000 7f7cba54f700 1 -- 172.21.15.190:0/1259739238 shutdown_connections 2020-04-02T23:48:42.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.064+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1259739238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cb4136fa0 0x7f7cb40a4a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.064+0000 7f7cba54f700 1 -- 172.21.15.190:0/1259739238 >> 172.21.15.190:0/1259739238 conn(0x7f7cb405b3d0 msgr2=0x7f7cb405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:42.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.064+0000 7f7cba54f700 1 -- 172.21.15.190:0/1259739238 shutdown_connections 2020-04-02T23:48:42.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.064+0000 7f7cba54f700 1 -- 172.21.15.190:0/1259739238 wait complete. 2020-04-02T23:48:42.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.065+0000 7f7cba54f700 1 Processor -- start 2020-04-02T23:48:42.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.065+0000 7f7cba54f700 1 -- start start 2020-04-02T23:48:42.068 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cba54f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7cb40a3af0 0x7f7cb4144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cba54f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cb4136fa0 0x7f7cb4148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cba54f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb4148330 con 0x7f7cb40a8470 2020-04-02T23:48:42.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cba54f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb4148590 con 0x7f7cb40a3af0 2020-04-02T23:48:42.069 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cba54f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb4148830 con 0x7f7cb4136fa0 2020-04-02T23:48:42.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.066+0000 7f7cb8aec700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cb4136fa0 0x7f7cb4148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.067+0000 7f7cb8aec700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cb4136fa0 0x7f7cb4148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60868/0 (socket says 172.21.15.190:60868) 2020-04-02T23:48:42.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.067+0000 7f7cb8aec700 1 -- 172.21.15.190:0/1023567618 learned_addr learned my addr 172.21.15.190:0/1023567618 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:42.070 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.067+0000 7f7cb3fff700 1 --2- 172.21.15.190:0/1023567618 >> v2:172.21.15.78:3300/0 conn(0x7f7cb40a3af0 0x7f7cb4144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.071+0000 7f7cb8aec700 1 -- 172.21.15.190:0/1023567618 >> v2:172.21.15.78:3300/0 conn(0x7f7cb40a3af0 msgr2=0x7f7cb4144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.071+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> v2:172.21.15.78:3300/0 conn(0x7f7cb40a3af0 0x7f7cb4144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.071+0000 7f7cb8aec700 1 -- 172.21.15.190:0/1023567618 >> v1:172.21.15.78:6789/0 conn(0x7f7cb40a8470 legacy=0x7f7cb4066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.071+0000 7f7cb8aec700 1 -- 172.21.15.190:0/1023567618 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4149130 con 0x7f7cb4136fa0 2020-04-02T23:48:42.073 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.071+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> v2:172.21.15.190:3300/0 conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.073+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> v2:172.21.15.190:3300/0 conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.073+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac012370 con 0x7f7cb4136fa0 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0124d0 con 0x7f7cb4136fa0 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac0128f0 con 0x7f7cb4136fa0 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb4066820 con 0x7f7cb4136fa0 2020-04-02T23:48:42.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.077+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb4135690 con 0x7f7cb4136fa0 2020-04-02T23:48:42.081 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.078+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb4148a00 con 0x7f7cb4136fa0 2020-04-02T23:48:42.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.263+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7cac012a50 con 0x7f7cb4136fa0 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb1ffb700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7cac0614d0 con 0x7f7cb4136fa0 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7cac061850 con 0x7f7cb4136fa0 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb3fff700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.264+0000 7f7cb3fff700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ca4001260 tx=0x7f7ca4001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.265+0000 7f7cb3fff700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ca4001260 tx=0x7f7ca4001d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.265+0000 7f7cb3fff700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f7ca4001260 tx=0x7f7ca4001d10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.409 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.407+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7cb4056ec0 con 0x7f7cb4136fa0 2020-04-02T23:48:42.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.410+0000 7f7cb8aec700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.410+0000 7f7cb1ffb700 1 -- 172.21.15.190:0/1023567618 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cac03cbf0 con 0x7f7cb4136fa0 2020-04-02T23:48:42.413 INFO:teuthology.orchestra.run.smithi190.stdout:64424509450 2020-04-02T23:48:42.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 msgr2=0x7f7c9804fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f7ca4001260 tx=0x7f7ca4001d10).stop 2020-04-02T23:48:42.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 msgr2=0x7f7cb4148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f7cac001450 tx=0x7f7cac00c7e0).stop 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 shutdown_connections 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f7c9804d5d0 0x7f7c9804fae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1023567618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4136fa0 0x7f7cb4148cd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 --2- 172.21.15.190:0/1023567618 >> v2:172.21.15.78:3300/0 conn(0x7f7cb40a3af0 0x7f7cb4144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 >> 172.21.15.190:0/1023567618 conn(0x7f7cb405b3d0 msgr2=0x7f7cb40a5310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:42.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 shutdown_connections 2020-04-02T23:48:42.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.412+0000 7f7cba54f700 1 -- 172.21.15.190:0/1023567618 wait complete. 2020-04-02T23:48:42.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.3 2020-04-02T23:48:42.425 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:42.437 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-02T23:48:42.585 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 Processor -- start 2020-04-02T23:48:42.585 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 -- start start 2020-04-02T23:48:42.585 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:42.585 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc1373b0 con 0x7f50fc0a3af0 2020-04-02T23:48:42.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc0a4ed0 con 0x7f50fc0a8470 2020-04-02T23:48:42.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.583+0000 7f5104143700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0a5110 con 0x7f50fc136fa0 2020-04-02T23:48:42.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.584+0000 7f51026e0700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f50fc0a8470 0x7f50fc140bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54096/0 (socket says 172.21.15.190:54096) 2020-04-02T23:48:42.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.584+0000 7f51026e0700 1 -- 172.21.15.190:0/1265782288 learned_addr learned my addr 172.21.15.190:0/1265782288 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:42.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.584+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362146138 0 0) 0x7f50f4001450 con 0x7f50fc0a8470 2020-04-02T23:48:42.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e4003230 con 0x7f50fc0a8470 2020-04-02T23:48:42.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724040940 0 0) 0x7f50fc1373b0 con 0x7f50fc0a3af0 2020-04-02T23:48:42.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f4001450 con 0x7f50fc0a3af0 2020-04-02T23:48:42.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f51016de700 1 -- 172.21.15.190:0/1265782288 >> v1:172.21.15.190:6789/0 conn(0x7f50fc0a8470 legacy=0x7f50fc140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f51016de700 1 -- 172.21.15.190:0/1265782288 >> v1:172.21.15.78:6789/0 conn(0x7f50fc0a3af0 legacy=0x7f50fc136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.587+0000 7f51016de700 1 -- 172.21.15.190:0/1265782288 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0a3650 con 0x7f50fc136fa0 2020-04-02T23:48:42.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.588+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50f8002f30 tx=0x7f50f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.589+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50f8002f30 tx=0x7f50f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.589+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f50f8002f30 tx=0x7f50f80088e0).ready entity=mon.2 client_cookie=7dbc810fce8a47d8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.596 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f50f8002f30 tx=0x7f50f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f50f8002f30 tx=0x7f50f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f51016de700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7f50f8002f30 tx=0x7f50f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f8008e40 con 0x7f50fc136fa0 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8011540 con 0x7f50fc136fa0 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f5100edd700 1 -- 172.21.15.190:0/1265782288 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f8011960 con 0x7f50fc136fa0 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f5104143700 1 -- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 msgr2=0x7f50fc0a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.597 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.594+0000 7f5104143700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f50f8002f30 tx=0x7f50f80088e0).stop 2020-04-02T23:48:42.599 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.595+0000 7f5104143700 1 -- 172.21.15.190:0/1265782288 shutdown_connections 2020-04-02T23:48:42.599 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.595+0000 7f5104143700 1 --2- 172.21.15.190:0/1265782288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc136fa0 0x7f50fc0a4a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.599 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.595+0000 7f5104143700 1 -- 172.21.15.190:0/1265782288 >> 172.21.15.190:0/1265782288 conn(0x7f50fc05b3d0 msgr2=0x7f50fc05b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:42.599 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.595+0000 7f5104143700 1 -- 172.21.15.190:0/1265782288 shutdown_connections 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.595+0000 7f5104143700 1 -- 172.21.15.190:0/1265782288 wait complete. 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 Processor -- start 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 -- start start 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc0a3af0 0x7f50fc1249f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50fc0a8470 0x7f50fc09fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.600 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50fc136fa0 0x7f50fc0a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc0a0ea0 con 0x7f50fc0a8470 2020-04-02T23:48:42.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc0a5310 con 0x7f50fc136fa0 2020-04-02T23:48:42.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.596+0000 7f5104143700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc125020 con 0x7f50fc0a3af0 2020-04-02T23:48:42.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.597+0000 7f51026e0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50fc136fa0 0x7f50fc0a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.601 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.597+0000 7f51016de700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50fc0a8470 0x7f50fc09fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.597+0000 7f5101edf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc0a3af0 0x7f50fc1249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.597+0000 7f51026e0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50fc136fa0 0x7f50fc0a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60882/0 (socket says 172.21.15.190:60882) 2020-04-02T23:48:42.602 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.597+0000 7f51026e0700 1 -- 172.21.15.190:0/2713923455 learned_addr learned my addr 172.21.15.190:0/2713923455 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:42.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.601+0000 7f51026e0700 1 -- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc0a3af0 msgr2=0x7f50fc1249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.601+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc0a3af0 0x7f50fc1249f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.601+0000 7f51026e0700 1 -- 172.21.15.190:0/2713923455 >> v2:172.21.15.78:3300/0 conn(0x7f50fc0a8470 msgr2=0x7f50fc09fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.601+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> v2:172.21.15.78:3300/0 conn(0x7f50fc0a8470 0x7f50fc09fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.601+0000 7f51026e0700 1 -- 172.21.15.190:0/2713923455 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc1252c0 con 0x7f50fc136fa0 2020-04-02T23:48:42.604 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.602+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> v2:172.21.15.190:3300/0 conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.605 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.603+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> v2:172.21.15.190:3300/0 conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.605 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.603+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f4010440 con 0x7f50fc136fa0 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40105a0 con 0x7f50fc136fa0 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc09f840 con 0x7f50fc136fa0 2020-04-02T23:48:42.610 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f4012450 con 0x7f50fc136fa0 2020-04-02T23:48:42.611 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.607+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc0a2360 con 0x7f50fc136fa0 2020-04-02T23:48:42.611 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.609+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc056ec0 con 0x7f50fc136fa0 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.798+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.798+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.798+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f50f4005940 con 0x7f50fc136fa0 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.798+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f50eaffd700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:42.801 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f50f4060df0 con 0x7f50fc136fa0 2020-04-02T23:48:42.802 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f50f40610b0 con 0x7f50fc136fa0 2020-04-02T23:48:42.802 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f5101edf700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:42.802 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f5101edf700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50ec0010d0 tx=0x7f50ec003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.802 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f5101edf700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50ec0010d0 tx=0x7f50ec003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.803 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.799+0000 7f5101edf700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f50ec0010d0 tx=0x7f50ec003e60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:42.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.949+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f50fc0a4ed0 con 0x7f50fc136fa0 2020-04-02T23:48:42.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.953+0000 7f51026e0700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:42.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.953+0000 7f50eaffd700 1 -- 172.21.15.190:0/2713923455 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50fc0a4ed0 con 0x7f50fc136fa0 2020-04-02T23:48:42.956 INFO:teuthology.orchestra.run.smithi190.stdout:64424509449 2020-04-02T23:48:42.957 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 msgr2=0x7f50dc04fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f50ec0010d0 tx=0x7f50ec003e60).stop 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 msgr2=0x7f50fc0a0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f50f40015e0 tx=0x7f50f400c970).stop 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 shutdown_connections 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f50dc04d5a0 0x7f50dc04fab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50fc136fa0 0x7f50fc0a0140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50fc0a3af0 0x7f50fc1249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 --2- 172.21.15.190:0/2713923455 >> v2:172.21.15.78:3300/0 conn(0x7f50fc0a8470 0x7f50fc09fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 >> 172.21.15.190:0/2713923455 conn(0x7f50fc05b3d0 msgr2=0x7f50fc1397e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 shutdown_connections 2020-04-02T23:48:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:42.955+0000 7f5104143700 1 -- 172.21.15.190:0/2713923455 wait complete. 2020-04-02T23:48:42.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2020-04-02T23:48:42.968 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:42.981 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-02T23:48:43.129 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.127+0000 7f08b9193700 1 Processor -- start 2020-04-02T23:48:43.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.127+0000 7f08b9193700 1 -- start start 2020-04-02T23:48:43.130 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.128+0000 7f08b9193700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:43.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.128+0000 7f08b9193700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f08b40a7340 0x7f08b40a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:43.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.128+0000 7f08b9193700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b4137150 con 0x7f08b409f130 2020-04-02T23:48:43.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.128+0000 7f08b9193700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b409f540 con 0x7f08b40a5e60 2020-04-02T23:48:43.131 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.128+0000 7f08b9193700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4136c10 con 0x7f08b40a7340 2020-04-02T23:48:43.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.129+0000 7f08b259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.132 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.129+0000 7f08b2d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f08b409f130 0x7f08b4136220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36506/0 (socket says 172.21.15.190:36506) 2020-04-02T23:48:43.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.129+0000 7f08b2d9d700 1 -- 172.21.15.190:0/1437518246 learned_addr learned my addr 172.21.15.190:0/1437518246 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:43.133 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.129+0000 7f08b359e700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f08b40a7340 0x7f08b40a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.134 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b1d9b700 1 -- 172.21.15.190:0/1437518246 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225642389 0 0) 0x7f08b4137150 con 0x7f08b409f130 2020-04-02T23:48:43.134 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b1d9b700 1 -- 172.21.15.190:0/1437518246 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0898003230 con 0x7f08b409f130 2020-04-02T23:48:43.134 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b259c700 1 -- 172.21.15.190:0/1437518246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f08b40a7340 msgr2=0x7f08b40a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:43.135 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f08b40a7340 0x7f08b40a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:43.135 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b259c700 1 -- 172.21.15.190:0/1437518246 >> v1:172.21.15.78:6789/0 conn(0x7f08b409f130 legacy=0x7f08b4136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.135 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.132+0000 7f08b259c700 1 -- 172.21.15.190:0/1437518246 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4136eb0 con 0x7f08b40a5e60 2020-04-02T23:48:43.136 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.133+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.136 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.134+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.136 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.134+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).ready entity=mon.1 client_cookie=b28bf7bcbc3e17f8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.139 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.137+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.139 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.137+0000 7f08b1d9b700 1 -- 172.21.15.190:0/1437518246 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a4011310 con 0x7f08b40a5e60 2020-04-02T23:48:43.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b259c700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.141 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b1d9b700 1 -- 172.21.15.190:0/1437518246 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4011470 con 0x7f08b40a5e60 2020-04-02T23:48:43.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b1d9b700 1 -- 172.21.15.190:0/1437518246 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a4011850 con 0x7f08b40a5e60 2020-04-02T23:48:43.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b9193700 1 -- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 msgr2=0x7f08b40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.142 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.139+0000 7f08b9193700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).stop 2020-04-02T23:48:43.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 -- 172.21.15.190:0/1437518246 shutdown_connections 2020-04-02T23:48:43.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f08b40a7340 0x7f08b40a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:43.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 --2- 172.21.15.190:0/1437518246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b40a6270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:43.143 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 -- 172.21.15.190:0/1437518246 >> 172.21.15.190:0/1437518246 conn(0x7f08b40624e0 msgr2=0x7f08b405c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:43.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 -- 172.21.15.190:0/1437518246 shutdown_connections 2020-04-02T23:48:43.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.140+0000 7f08b9193700 1 -- 172.21.15.190:0/1437518246 wait complete. 2020-04-02T23:48:43.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.141+0000 7f08b9193700 1 Processor -- start 2020-04-02T23:48:43.144 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.141+0000 7f08b9193700 1 -- start start 2020-04-02T23:48:43.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b9193700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b412db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:43.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b9193700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b40aa600 con 0x7f08b40a7340 2020-04-02T23:48:43.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b9193700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b40aa8a0 con 0x7f08b409f130 2020-04-02T23:48:43.145 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b9193700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b40aab40 con 0x7f08b40a5e60 2020-04-02T23:48:43.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b359e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f08b40a7340 0x7f08b405b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36516/0 (socket says 172.21.15.190:36516) 2020-04-02T23:48:43.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b359e700 1 -- 172.21.15.190:0/2449917604 learned_addr learned my addr 172.21.15.190:0/2449917604 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:43.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.142+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b412db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.146 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.145+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882587677 0 0) 0x7f08b40aa600 con 0x7f08b40a7340 2020-04-02T23:48:43.147 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.145+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0890002fe0 con 0x7f08b40a7340 2020-04-02T23:48:43.148 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.146+0000 7f08b259c700 1 -- 172.21.15.190:0/2449917604 >> v1:172.21.15.190:6789/0 conn(0x7f08b409f130 legacy=0x7f08b40aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.148 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.146+0000 7f08b259c700 1 -- 172.21.15.190:0/2449917604 >> v1:172.21.15.78:6789/0 conn(0x7f08b40a7340 legacy=0x7f08b405b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.149 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.146+0000 7f08b259c700 1 -- 172.21.15.190:0/2449917604 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40ac190 con 0x7f08b40a5e60 2020-04-02T23:48:43.149 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.147+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.151 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.149+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> v2:172.21.15.190:3300/0 conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.151 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.149+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.156 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a400f760 con 0x7f08b40a5e60 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4007150 con 0x7f08b40a5e60 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b413f020 con 0x7f08b40a5e60 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a40074f0 con 0x7f08b40a5e60 2020-04-02T23:48:43.157 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.154+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b405be80 con 0x7f08b40a5e60 2020-04-02T23:48:43.158 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.155+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4135d60 con 0x7f08b40a5e60 2020-04-02T23:48:43.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.168+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.169+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f08a40056c0 con 0x7f08b40a5e60 2020-04-02T23:48:43.171 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.169+0000 7f08a3fff700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:43.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.169+0000 7f08b2d9d700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.170+0000 7f08b2d9d700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08b40aaa30 tx=0x7f08ac001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.170+0000 7f08b2d9d700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08b40aaa30 tx=0x7f08ac001ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.172 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.170+0000 7f08b2d9d700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f08b40aaa30 tx=0x7f08ac001ff0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.172+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.172+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f08a4040f20 con 0x7f08b40a5e60 2020-04-02T23:48:43.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.346+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.349 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.346+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f08a403d2c0 con 0x7f08b40a5e60 2020-04-02T23:48:43.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.485+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f08b405c130 con 0x7f08b40a5e60 2020-04-02T23:48:43.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.524+0000 7f08b259c700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.526 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.524+0000 7f08a3fff700 1 -- 172.21.15.190:0/2449917604 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08b405c130 con 0x7f08b40a5e60 2020-04-02T23:48:43.527 INFO:teuthology.orchestra.run.smithi190.stdout:68719476745 2020-04-02T23:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 msgr2=0x7f089004fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f08b40aaa30 tx=0x7f08ac001ff0).stop 2020-04-02T23:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 msgr2=0x7f08b412db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f08a4002f30 tx=0x7f08a4007a40).stop 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 shutdown_connections 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f089004d930 0x7f089004fe40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.526+0000 7f08b9193700 1 --2- 172.21.15.190:0/2449917604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40a5e60 0x7f08b412db60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.527+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 >> 172.21.15.190:0/2449917604 conn(0x7f08b40624e0 msgr2=0x7f08b412fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.527+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 shutdown_connections 2020-04-02T23:48:43.530 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.527+0000 7f08b9193700 1 -- 172.21.15.190:0/2449917604 wait complete. 2020-04-02T23:48:43.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476745 for osd.5 2020-04-02T23:48:43.541 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:43.555 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-02T23:48:43.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.702+0000 7f0db58c3700 1 Processor -- start 2020-04-02T23:48:43.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.702+0000 7f0db58c3700 1 -- start start 2020-04-02T23:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.703+0000 7f0db58c3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0db0067120 0x7f0db009fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.703+0000 7f0db58c3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.703+0000 7f0db58c3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00a88f0 con 0x7f0db013cec0 2020-04-02T23:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.703+0000 7f0db58c3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db013d2d0 con 0x7f0db0067120 2020-04-02T23:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.703+0000 7f0db58c3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00a7f10 con 0x7f0db00a0160 2020-04-02T23:48:43.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.704+0000 7f0daf7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0db013cec0 0x7f0db00a7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54120/0 (socket says 172.21.15.190:54120) 2020-04-02T23:48:43.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.704+0000 7f0daf7fe700 1 -- 172.21.15.190:0/3763126415 learned_addr learned my addr 172.21.15.190:0/3763126415 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:43.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.704+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.708 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.704+0000 7f0daeffd700 1 --2- 172.21.15.190:0/3763126415 >> v2:172.21.15.78:3300/0 conn(0x7f0db0067120 0x7f0db009fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.706+0000 7f0dae7fc700 1 -- 172.21.15.190:0/3763126415 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18147760 0 0) 0x7f0db00a88f0 con 0x7f0db013cec0 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.706+0000 7f0dae7fc700 1 -- 172.21.15.190:0/3763126415 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d90003230 con 0x7f0db013cec0 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.707+0000 7f0da7fff700 1 -- 172.21.15.190:0/3763126415 >> v2:172.21.15.78:3300/0 conn(0x7f0db0067120 msgr2=0x7f0db009fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.707+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> v2:172.21.15.78:3300/0 conn(0x7f0db0067120 0x7f0db009fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.707+0000 7f0da7fff700 1 -- 172.21.15.190:0/3763126415 >> v1:172.21.15.190:6789/0 conn(0x7f0db013cec0 legacy=0x7f0db00a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.712 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.707+0000 7f0da7fff700 1 -- 172.21.15.190:0/3763126415 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00a81b0 con 0x7f0db00a0160 2020-04-02T23:48:43.713 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.707+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d98002f30 tx=0x7f0d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.713 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.709+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d98002f30 tx=0x7f0d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.713 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.709+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f0d98002f30 tx=0x7f0d98007a40).ready entity=mon.2 client_cookie=9c16985cae820d89 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.715 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0d98002f30 tx=0x7f0d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0d98002f30 tx=0x7f0d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0da7fff700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0d98002f30 tx=0x7f0d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0dae7fc700 1 -- 172.21.15.190:0/3763126415 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d98011310 con 0x7f0db00a0160 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0dae7fc700 1 -- 172.21.15.190:0/3763126415 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98011470 con 0x7f0db00a0160 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0dae7fc700 1 -- 172.21.15.190:0/3763126415 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d98011890 con 0x7f0db00a0160 2020-04-02T23:48:43.716 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0db58c3700 1 -- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 msgr2=0x7f0db013ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.717 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.713+0000 7f0db58c3700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f0d98002f30 tx=0x7f0d98007a40).stop 2020-04-02T23:48:43.718 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 -- 172.21.15.190:0/3763126415 shutdown_connections 2020-04-02T23:48:43.718 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 --2- 172.21.15.190:0/3763126415 >> v2:172.21.15.78:3300/0 conn(0x7f0db0067120 0x7f0db009fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:43.718 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 --2- 172.21.15.190:0/3763126415 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db00a0160 0x7f0db013ca60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:43.718 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 -- 172.21.15.190:0/3763126415 >> 172.21.15.190:0/3763126415 conn(0x7f0db00624e0 msgr2=0x7f0db005c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:43.719 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 -- 172.21.15.190:0/3763126415 shutdown_connections 2020-04-02T23:48:43.719 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.714+0000 7f0db58c3700 1 -- 172.21.15.190:0/3763126415 wait complete. 2020-04-02T23:48:43.720 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.715+0000 7f0db58c3700 1 Processor -- start 2020-04-02T23:48:43.720 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.715+0000 7f0db58c3700 1 -- start start 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.715+0000 7f0db58c3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0db00a0160 0x7f0db014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.715+0000 7f0db58c3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0db58c3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00a2240 con 0x7f0db0067120 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0db58c3700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db014a240 con 0x7f0db00a0160 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0db58c3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db014a4e0 con 0x7f0db013cec0 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0daf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.721 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0da7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0db00a0160 0x7f0db014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0daeffd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0db0067120 0x7f0db00a19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54126/0 (socket says 172.21.15.190:54126) 2020-04-02T23:48:43.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.716+0000 7f0daeffd700 1 -- 172.21.15.190:0/380169388 learned_addr learned my addr 172.21.15.190:0/380169388 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:43.722 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.719+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075955997 0 0) 0x7f0db00a2240 con 0x7f0db0067120 2020-04-02T23:48:43.723 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.719+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d94002fe0 con 0x7f0db0067120 2020-04-02T23:48:43.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.720+0000 7f0daf7fe700 1 -- 172.21.15.190:0/380169388 >> v2:172.21.15.190:3300/0 conn(0x7f0db00a0160 msgr2=0x7f0db014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.720+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> v2:172.21.15.190:3300/0 conn(0x7f0db00a0160 0x7f0db014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:43.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.720+0000 7f0daf7fe700 1 -- 172.21.15.190:0/380169388 >> v1:172.21.15.190:6789/0 conn(0x7f0db0067120 legacy=0x7f0db00a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:43.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.720+0000 7f0daf7fe700 1 -- 172.21.15.190:0/380169388 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0146cf0 con 0x7f0db013cec0 2020-04-02T23:48:43.726 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.720+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.727 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.722+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.727 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.722+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.730 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.727+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da8005e50 con 0x7f0db013cec0 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8012390 con 0x7f0db013cec0 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da80127b0 con 0x7f0db013cec0 2020-04-02T23:48:43.731 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db00a35a0 con 0x7f0db013cec0 2020-04-02T23:48:43.732 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.728+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db00a68c0 con 0x7f0db013cec0 2020-04-02T23:48:43.732 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.729+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0056ec0 con 0x7f0db013cec0 2020-04-02T23:48:43.746 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.745+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.745+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0da8012910 con 0x7f0db013cec0 2020-04-02T23:48:43.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.745+0000 7f0dacff9700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:43.747 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.746+0000 7f0daeffd700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:43.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.746+0000 7f0daeffd700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0da0007fe0 tx=0x7f0da00090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.746+0000 7f0daeffd700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0da0007fe0 tx=0x7f0da00090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.748 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.746+0000 7f0daeffd700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f0da0007fe0 tx=0x7f0da00090b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:43.864 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.862+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.864 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.862+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0da8040720 con 0x7f0db013cec0 2020-04-02T23:48:43.922 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.920+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:43.923 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:43.920+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f0da803cac0 con 0x7f0db013cec0 2020-04-02T23:48:44.067 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.065+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0db013a2d0 con 0x7f0db013cec0 2020-04-02T23:48:44.074 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.072+0000 7f0daf7fe700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.075 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.072+0000 7f0dacff9700 1 -- 172.21.15.190:0/380169388 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0da80400e0 con 0x7f0db013cec0 2020-04-02T23:48:44.075 INFO:teuthology.orchestra.run.smithi190.stdout:64424509448 2020-04-02T23:48:44.076 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 msgr2=0x7f0d9404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f0da0007fe0 tx=0x7f0da00090b0).stop 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 msgr2=0x7f0db014ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f0db00a2e50 tx=0x7f0da8010bf0).stop 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 shutdown_connections 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f0d9404d940 0x7f0d9404fe50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 --2- 172.21.15.190:0/380169388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db013cec0 0x7f0db014ade0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.077 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 --2- 172.21.15.190:0/380169388 >> v2:172.21.15.190:3300/0 conn(0x7f0db00a0160 0x7f0db014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 >> 172.21.15.190:0/380169388 conn(0x7f0db00624e0 msgr2=0x7f0db006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:44.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 shutdown_connections 2020-04-02T23:48:44.078 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.074+0000 7f0db58c3700 1 -- 172.21.15.190:0/380169388 wait complete. 2020-04-02T23:48:44.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2020-04-02T23:48:44.086 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:44.099 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-02T23:48:44.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 Processor -- start 2020-04-02T23:48:44.249 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 -- start start 2020-04-02T23:48:44.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740ac2c0 0x7f17740a4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:44.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17740a4770 0x7f17740a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:44.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17740a79f0 con 0x7f17740a8370 2020-04-02T23:48:44.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17740a3730 con 0x7f17740a4770 2020-04-02T23:48:44.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.247+0000 7f177aacf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740a5320 con 0x7f17740ac2c0 2020-04-02T23:48:44.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.248+0000 7f1773fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17740a4770 0x7f17740a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.249+0000 7f177906c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17740a8370 0x7f17740a8780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36534/0 (socket says 172.21.15.190:36534) 2020-04-02T23:48:44.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.249+0000 7f177906c700 1 -- 172.21.15.190:0/258418092 learned_addr learned my addr 172.21.15.190:0/258418092 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:44.253 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.252+0000 7f1773fff700 1 -- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740ac2c0 msgr2=0x7f17740a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:44.254 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.252+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740ac2c0 0x7f17740a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:44.254 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.252+0000 7f1773fff700 1 -- 172.21.15.190:0/258418092 >> v1:172.21.15.78:6789/0 conn(0x7f17740a8370 legacy=0x7f17740a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:44.254 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.252+0000 7f1773fff700 1 -- 172.21.15.190:0/258418092 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740a55c0 con 0x7f17740a4770 2020-04-02T23:48:44.254 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.252+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> v2:172.21.15.78:3300/0 conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.255 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.254+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> v2:172.21.15.78:3300/0 conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.255 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.254+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).ready entity=mon.0 client_cookie=5a05be07f5e86940 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:44.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f1773fff700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.264 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f17737fe700 1 -- 172.21.15.190:0/258418092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1760008d00 con 0x7f17740a4770 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f17737fe700 1 -- 172.21.15.190:0/258418092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760008e60 con 0x7f17740a4770 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f17737fe700 1 -- 172.21.15.190:0/258418092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1760010350 con 0x7f17740a4770 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f177aacf700 1 -- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 msgr2=0x7f17740a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.259+0000 7f177aacf700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).stop 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 -- 172.21.15.190:0/258418092 shutdown_connections 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740ac2c0 0x7f17740a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:44.265 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 --2- 172.21.15.190:0/258418092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17740a4770 0x7f17740a7f10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 -- 172.21.15.190:0/258418092 >> 172.21.15.190:0/258418092 conn(0x7f177405b3d0 msgr2=0x7f177405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 -- 172.21.15.190:0/258418092 shutdown_connections 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.260+0000 7f177aacf700 1 -- 172.21.15.190:0/258418092 wait complete. 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.261+0000 7f177aacf700 1 Processor -- start 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.261+0000 7f177aacf700 1 -- start start 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.266 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f17740a8370 0x7f1774063110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17740ac2c0 0x7f17741431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1774142b10 con 0x7f17740ac2c0 2020-04-02T23:48:44.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17740a22e0 con 0x7f17740a8370 2020-04-02T23:48:44.267 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177aacf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1774063570 con 0x7f17740a4770 2020-04-02T23:48:44.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.262+0000 7f177886b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.263+0000 7f177886b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46772/0 (socket says 172.21.15.190:46772) 2020-04-02T23:48:44.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.263+0000 7f177886b700 1 -- 172.21.15.190:0/4007715251 learned_addr learned my addr 172.21.15.190:0/4007715251 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:44.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.263+0000 7f1773fff700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.190:3300/0 conn(0x7f17740a8370 0x7f1774063110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.268 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.263+0000 7f177906c700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.78:3300/0 conn(0x7f17740ac2c0 0x7f17741431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.269 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.266+0000 7f177886b700 1 -- 172.21.15.190:0/4007715251 >> v2:172.21.15.190:3300/0 conn(0x7f17740a8370 msgr2=0x7f1774063110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.269 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.266+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.190:3300/0 conn(0x7f17740a8370 0x7f1774063110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.269 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.266+0000 7f177886b700 1 -- 172.21.15.190:0/4007715251 >> v2:172.21.15.78:3300/0 conn(0x7f17740ac2c0 msgr2=0x7f17741431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.270 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.266+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.78:3300/0 conn(0x7f17740ac2c0 0x7f17741431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.270 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.266+0000 7f177886b700 1 -- 172.21.15.190:0/4007715251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740a24e0 con 0x7f17740a4770 2020-04-02T23:48:44.270 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.267+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.270 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.268+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.270 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.268+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:44.274 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.272+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.274 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.272+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1768005df0 con 0x7f17740a4770 2020-04-02T23:48:44.274 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.272+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1774142d00 con 0x7f17740a4770 2020-04-02T23:48:44.274 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.272+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1774135ed0 con 0x7f17740a4770 2020-04-02T23:48:44.275 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.273+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1774056ec0 con 0x7f17740a4770 2020-04-02T23:48:44.275 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.273+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.276 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.273+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.276 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.273+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768007160 con 0x7f17740a4770 2020-04-02T23:48:44.276 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.273+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1768007580 con 0x7f17740a4770 2020-04-02T23:48:44.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.381+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.381+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1768008970 con 0x7f17740a4770 2020-04-02T23:48:44.385 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.381+0000 7f1771ffb700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.385 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.382+0000 7f1773fff700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.382+0000 7f1773fff700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.382+0000 7f1773fff700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.382+0000 7f1773fff700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:44.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.384+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.387 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.384+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1768040180 con 0x7f17740a4770 2020-04-02T23:48:44.470 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.468+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.470 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.468+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f176803c520 con 0x7f17740a4770 2020-04-02T23:48:44.649 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.647+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f177405c3e0 con 0x7f17740a4770 2020-04-02T23:48:44.653 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.651+0000 7f177886b700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.654 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.651+0000 7f1771ffb700 1 -- 172.21.15.190:0/4007715251 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f176803fb40 con 0x7f17740a4770 2020-04-02T23:48:44.654 INFO:teuthology.orchestra.run.smithi190.stdout:64424509447 2020-04-02T23:48:44.655 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 msgr2=0x7f175c04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.655 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f17740a4140 tx=0x7f1760007a40).stop 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 msgr2=0x7f17740a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f1768002f30 tx=0x7f1768010990).stop 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 shutdown_connections 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f175c04d570 0x7f175c04fa80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.78:3300/0 conn(0x7f17740ac2c0 0x7f17741431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.656 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17740a4770 0x7f17740a1e80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.657 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 --2- 172.21.15.190:0/4007715251 >> v2:172.21.15.190:3300/0 conn(0x7f17740a8370 0x7f1774063110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.657 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 >> 172.21.15.190:0/4007715251 conn(0x7f177405b3d0 msgr2=0x7f177406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:44.657 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 shutdown_connections 2020-04-02T23:48:44.657 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.653+0000 7f177aacf700 1 -- 172.21.15.190:0/4007715251 wait complete. 2020-04-02T23:48:44.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2020-04-02T23:48:44.668 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-02T23:48:44.668 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:44.694 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:48:44.869 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.867+0000 7f7661a0f700 1 Processor -- start 2020-04-02T23:48:44.870 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.867+0000 7f7661a0f700 1 -- start start 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.868+0000 7f7661a0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c0ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.868+0000 7f7661a0f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.868+0000 7f7661a0f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0aba80 con 0x7f765c066500 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.868+0000 7f7661a0f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c066da0 con 0x7f765c0a6430 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.868+0000 7f7661a0f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c067040 con 0x7f765c1398f0 2020-04-02T23:48:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.869+0000 7f765b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.869+0000 7f765b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46796/0 (socket says 172.21.15.190:46796) 2020-04-02T23:48:44.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.869+0000 7f765b7fe700 1 -- 172.21.15.190:0/1149566555 learned_addr learned my addr 172.21.15.190:0/1149566555 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:44.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.869+0000 7f765affd700 1 --2- 172.21.15.190:0/1149566555 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c0ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.872+0000 7f765b7fe700 1 -- 172.21.15.190:0/1149566555 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 msgr2=0x7f765c0ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:44.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.872+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c0ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:44.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.872+0000 7f765b7fe700 1 -- 172.21.15.190:0/1149566555 >> v1:172.21.15.78:6789/0 conn(0x7f765c066500 legacy=0x7f765c133340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.872+0000 7f765b7fe700 1 -- 172.21.15.190:0/1149566555 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c139420 con 0x7f765c1398f0 2020-04-02T23:48:44.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.872+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.874+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.874+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).ready entity=mon.2 client_cookie=88c9483e0a28f3c6 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:44.878 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.876+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.878 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.876+0000 7f765a7fc700 1 -- 172.21.15.190:0/1149566555 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f765400a160 con 0x7f765c1398f0 2020-04-02T23:48:44.880 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.878+0000 7f765b7fe700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.881 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.878+0000 7f765a7fc700 1 -- 172.21.15.190:0/1149566555 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400a2c0 con 0x7f765c1398f0 2020-04-02T23:48:44.881 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.878+0000 7f7661a0f700 1 -- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 msgr2=0x7f765c139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.881 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.878+0000 7f7661a0f700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).stop 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 -- 172.21.15.190:0/1149566555 shutdown_connections 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 --2- 172.21.15.190:0/1149566555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c1398f0 0x7f765c139d00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 --2- 172.21.15.190:0/1149566555 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c0ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 -- 172.21.15.190:0/1149566555 >> 172.21.15.190:0/1149566555 conn(0x7f765c0610f0 msgr2=0x7f765c09e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 -- 172.21.15.190:0/1149566555 shutdown_connections 2020-04-02T23:48:44.882 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.879+0000 7f7661a0f700 1 -- 172.21.15.190:0/1149566555 wait complete. 2020-04-02T23:48:44.883 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.880+0000 7f7661a0f700 1 Processor -- start 2020-04-02T23:48:44.883 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.880+0000 7f7661a0f700 1 -- start start 2020-04-02T23:48:44.884 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c066500 0x7f765c0a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.884 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.884 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f765c1398f0 0x7f765c133340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:44.884 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c09fc10 con 0x7f765c0a6430 2020-04-02T23:48:44.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c09feb0 con 0x7f765c1398f0 2020-04-02T23:48:44.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f7661a0f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c146fa0 con 0x7f765c066500 2020-04-02T23:48:44.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f765b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f765c1398f0 0x7f765c133340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f76527fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.885 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.881+0000 7f765affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c066500 0x7f765c0a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:44.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.882+0000 7f765b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f765c1398f0 0x7f765c133340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60948/0 (socket says 172.21.15.190:60948) 2020-04-02T23:48:44.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.882+0000 7f765b7fe700 1 -- 172.21.15.190:0/3049006009 learned_addr learned my addr 172.21.15.190:0/3049006009 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:44.887 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.885+0000 7f765b7fe700 1 -- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c066500 msgr2=0x7f765c0a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.888 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.885+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c066500 0x7f765c0a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.888 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.885+0000 7f765b7fe700 1 -- 172.21.15.190:0/3049006009 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 msgr2=0x7f765c146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:44.888 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.885+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:44.888 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.885+0000 7f765b7fe700 1 -- 172.21.15.190:0/3049006009 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0ab840 con 0x7f765c1398f0 2020-04-02T23:48:44.888 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.887+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> v2:172.21.15.190:3300/0 conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.890 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.888+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> v2:172.21.15.190:3300/0 conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.890 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.888+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:44.892 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.890+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:44.893 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.890+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f765400aea0 con 0x7f765c1398f0 2020-04-02T23:48:44.893 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.890+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0a31f0 con 0x7f765c1398f0 2020-04-02T23:48:44.893 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.890+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c133960 con 0x7f765c1398f0 2020-04-02T23:48:44.893 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:44.891+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c056ec0 con 0x7f765c1398f0 2020-04-02T23:48:45.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.160+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.161+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.161+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654005a40 con 0x7f765c1398f0 2020-04-02T23:48:45.163 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.161+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7654005da0 con 0x7f765c1398f0 2020-04-02T23:48:45.174 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.172+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7654007150 con 0x7f765c1398f0 2020-04-02T23:48:45.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f765b7fe700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.175 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f7658ff9700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:45.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7654062050 con 0x7f765c1398f0 2020-04-02T23:48:45.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f76540623d0 con 0x7f765c1398f0 2020-04-02T23:48:45.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.173+0000 7f765affd700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.176 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.174+0000 7f765affd700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f764c002f30 tx=0x7f764c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.174+0000 7f765affd700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f764c002f30 tx=0x7f764c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.177 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.174+0000 7f765affd700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f764c002f30 tx=0x7f764c00d8b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:45.348 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.346+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 --> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f765c09fa90 con 0x7f764004d590 2020-04-02T23:48:45.352 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.349+0000 7f765affd700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f764c002f30 tx=0x7f764c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.352 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.349+0000 7f7658ff9700 1 -- 172.21.15.190:0/3049006009 <== mgr.4105 v2:172.21.15.78:6800/24250 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82298 (secure 0 0 0) 0x7f764c00f310 con 0x7f764004d590 2020-04-02T23:48:45.352 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:45.354 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 msgr2=0x7f764004faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f764c002f30 tx=0x7f764c00d8b0).stop 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 msgr2=0x7f765c133340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f76540032b0 tx=0x7f7654007dc0).stop 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 shutdown_connections 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f764004d590 0x7f764004faa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f765c1398f0 0x7f765c133340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.355 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f765c066500 0x7f765c0a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 --2- 172.21.15.190:0/3049006009 >> v2:172.21.15.78:3300/0 conn(0x7f765c0a6430 0x7f765c146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 >> 172.21.15.190:0/3049006009 conn(0x7f765c0610f0 msgr2=0x7f765c06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:45.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 shutdown_connections 2020-04-02T23:48:45.356 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.352+0000 7f7661a0f700 1 -- 172.21.15.190:0/3049006009 wait complete. 2020-04-02T23:48:45.357 INFO:teuthology.orchestra.run.smithi190.stderr:dumped all 2020-04-02T23:48:45.366 INFO:teuthology.orchestra.run.smithi190.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2020-04-02T23:48:43.457599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":910712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.415856+0000","last_change":"2020-04-02T23:48:28.381231+0000","last_active":"2020-04-02T23:48:28.415856+0000","last_peered":"2020-04-02T23:48:28.415856+0000","last_clean":"2020-04-02T23:48:28.415856+0000","last_became_active":"2020-04-02T23:48:28.357043+0000","last_became_peered":"2020-04-02T23:48:28.357043+0000","last_unstale":"2020-04-02T23:48:28.415856+0000","last_undegraded":"2020-04-02T23:48:28.415856+0000","last_fullsized":"2020-04-02T23:48:28.415856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.179181+0000","last_change":"2020-04-02T23:48:20.940783+0000","last_active":"2020-04-02T23:48:28.179181+0000","last_peered":"2020-04-02T23:48:28.179181+0000","last_clean":"2020-04-02T23:48:28.179181+0000","last_became_active":"2020-04-02T23:48:20.924170+0000","last_became_peered":"2020-04-02T23:48:20.924170+0000","last_unstale":"2020-04-02T23:48:28.179181+0000","last_undegraded":"2020-04-02T23:48:28.179181+0000","last_fullsized":"2020-04-02T23:48:28.179181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.978563+0000","last_change":"2020-04-02T23:48:24.856124+0000","last_active":"2020-04-02T23:48:27.978563+0000","last_peered":"2020-04-02T23:48:27.978563+0000","last_clean":"2020-04-02T23:48:27.978563+0000","last_became_active":"2020-04-02T23:48:24.781557+0000","last_became_peered":"2020-04-02T23:48:24.781557+0000","last_unstale":"2020-04-02T23:48:27.978563+0000","last_undegraded":"2020-04-02T23:48:27.978563+0000","last_fullsized":"2020-04-02T23:48:27.978563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.516529+0000","last_change":"2020-04-02T23:48:28.494014+0000","last_active":"2020-04-02T23:48:28.516529+0000","last_peered":"2020-04-02T23:48:28.516529+0000","last_clean":"2020-04-02T23:48:28.516529+0000","last_became_active":"2020-04-02T23:48:28.481678+0000","last_became_peered":"2020-04-02T23:48:28.481678+0000","last_unstale":"2020-04-02T23:48:28.516529+0000","last_undegraded":"2020-04-02T23:48:28.516529+0000","last_fullsized":"2020-04-02T23:48:28.516529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.964719+0000","last_change":"2020-04-02T23:48:20.442132+0000","last_active":"2020-04-02T23:48:27.964719+0000","last_peered":"2020-04-02T23:48:27.964719+0000","last_clean":"2020-04-02T23:48:27.964719+0000","last_became_active":"2020-04-02T23:48:20.410561+0000","last_became_peered":"2020-04-02T23:48:20.410561+0000","last_unstale":"2020-04-02T23:48:27.964719+0000","last_undegraded":"2020-04-02T23:48:27.964719+0000","last_fullsized":"2020-04-02T23:48:27.964719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.086276+0000","last_change":"2020-04-02T23:48:24.962512+0000","last_active":"2020-04-02T23:48:28.086276+0000","last_peered":"2020-04-02T23:48:28.086276+0000","last_clean":"2020-04-02T23:48:28.086276+0000","last_became_active":"2020-04-02T23:48:24.922915+0000","last_became_peered":"2020-04-02T23:48:24.922915+0000","last_unstale":"2020-04-02T23:48:28.086276+0000","last_undegraded":"2020-04-02T23:48:28.086276+0000","last_fullsized":"2020-04-02T23:48:28.086276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.424333+0000","last_change":"2020-04-02T23:48:28.406614+0000","last_active":"2020-04-02T23:48:28.424333+0000","last_peered":"2020-04-02T23:48:28.424333+0000","last_clean":"2020-04-02T23:48:28.424333+0000","last_became_active":"2020-04-02T23:48:28.341042+0000","last_became_peered":"2020-04-02T23:48:28.341042+0000","last_unstale":"2020-04-02T23:48:28.424333+0000","last_undegraded":"2020-04-02T23:48:28.424333+0000","last_fullsized":"2020-04-02T23:48:28.424333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.449208+0000","last_change":"2020-04-02T23:48:20.647593+0000","last_active":"2020-04-02T23:48:28.449208+0000","last_peered":"2020-04-02T23:48:28.449208+0000","last_clean":"2020-04-02T23:48:28.449208+0000","last_became_active":"2020-04-02T23:48:20.603105+0000","last_became_peered":"2020-04-02T23:48:20.603105+0000","last_unstale":"2020-04-02T23:48:28.449208+0000","last_undegraded":"2020-04-02T23:48:28.449208+0000","last_fullsized":"2020-04-02T23:48:28.449208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.161493+0000","last_change":"2020-04-02T23:48:24.887433+0000","last_active":"2020-04-02T23:48:28.161493+0000","last_peered":"2020-04-02T23:48:28.161493+0000","last_clean":"2020-04-02T23:48:28.161493+0000","last_became_active":"2020-04-02T23:48:24.861509+0000","last_became_peered":"2020-04-02T23:48:24.861509+0000","last_unstale":"2020-04-02T23:48:28.161493+0000","last_undegraded":"2020-04-02T23:48:28.161493+0000","last_fullsized":"2020-04-02T23:48:28.161493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.642013+0000","last_change":"2020-04-02T23:48:28.609925+0000","last_active":"2020-04-02T23:48:28.642013+0000","last_peered":"2020-04-02T23:48:28.642013+0000","last_clean":"2020-04-02T23:48:28.642013+0000","last_became_active":"2020-04-02T23:48:28.583904+0000","last_became_peered":"2020-04-02T23:48:28.583904+0000","last_unstale":"2020-04-02T23:48:28.642013+0000","last_undegraded":"2020-04-02T23:48:28.642013+0000","last_fullsized":"2020-04-02T23:48:28.642013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.972281+0000","last_change":"2020-04-02T23:48:20.463644+0000","last_active":"2020-04-02T23:48:27.972281+0000","last_peered":"2020-04-02T23:48:27.972281+0000","last_clean":"2020-04-02T23:48:27.972281+0000","last_became_active":"2020-04-02T23:48:20.375230+0000","last_became_peered":"2020-04-02T23:48:20.375230+0000","last_unstale":"2020-04-02T23:48:27.972281+0000","last_undegraded":"2020-04-02T23:48:27.972281+0000","last_fullsized":"2020-04-02T23:48:27.972281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.516733+0000","last_change":"2020-04-02T23:48:15.780143+0000","last_active":"2020-04-02T23:48:28.516733+0000","last_peered":"2020-04-02T23:48:28.516733+0000","last_clean":"2020-04-02T23:48:28.516733+0000","last_became_active":"2020-04-02T23:48:15.749978+0000","last_became_peered":"2020-04-02T23:48:15.749978+0000","last_unstale":"2020-04-02T23:48:28.516733+0000","last_undegraded":"2020-04-02T23:48:28.516733+0000","last_fullsized":"2020-04-02T23:48:28.516733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:28.612987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:28.612987+0000","last_clean_scrub_stamp":"2020-04-02T23:47:28.612987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.985192+0000","last_change":"2020-04-02T23:48:24.933551+0000","last_active":"2020-04-02T23:48:27.985192+0000","last_peered":"2020-04-02T23:48:27.985192+0000","last_clean":"2020-04-02T23:48:27.985192+0000","last_became_active":"2020-04-02T23:48:24.918724+0000","last_became_peered":"2020-04-02T23:48:24.918724+0000","last_unstale":"2020-04-02T23:48:27.985192+0000","last_undegraded":"2020-04-02T23:48:27.985192+0000","last_fullsized":"2020-04-02T23:48:27.985192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.652319+0000","last_change":"2020-04-02T23:48:28.623804+0000","last_active":"2020-04-02T23:48:28.652319+0000","last_peered":"2020-04-02T23:48:28.652319+0000","last_clean":"2020-04-02T23:48:28.652319+0000","last_became_active":"2020-04-02T23:48:28.596644+0000","last_became_peered":"2020-04-02T23:48:28.596644+0000","last_unstale":"2020-04-02T23:48:28.652319+0000","last_undegraded":"2020-04-02T23:48:28.652319+0000","last_fullsized":"2020-04-02T23:48:28.652319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.518998+0000","last_change":"2020-04-02T23:48:20.419692+0000","last_active":"2020-04-02T23:48:28.518998+0000","last_peered":"2020-04-02T23:48:28.518998+0000","last_clean":"2020-04-02T23:48:28.518998+0000","last_became_active":"2020-04-02T23:48:20.389688+0000","last_became_peered":"2020-04-02T23:48:20.389688+0000","last_unstale":"2020-04-02T23:48:28.518998+0000","last_undegraded":"2020-04-02T23:48:28.518998+0000","last_fullsized":"2020-04-02T23:48:28.518998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.139646+0000","last_change":"2020-04-02T23:48:24.914910+0000","last_active":"2020-04-02T23:48:28.139646+0000","last_peered":"2020-04-02T23:48:28.139646+0000","last_clean":"2020-04-02T23:48:28.139646+0000","last_became_active":"2020-04-02T23:48:24.902034+0000","last_became_peered":"2020-04-02T23:48:24.902034+0000","last_unstale":"2020-04-02T23:48:28.139646+0000","last_undegraded":"2020-04-02T23:48:28.139646+0000","last_fullsized":"2020-04-02T23:48:28.139646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.613952+0000","last_change":"2020-04-02T23:48:28.560530+0000","last_active":"2020-04-02T23:48:28.613952+0000","last_peered":"2020-04-02T23:48:28.613952+0000","last_clean":"2020-04-02T23:48:28.613952+0000","last_became_active":"2020-04-02T23:48:28.532289+0000","last_became_peered":"2020-04-02T23:48:28.532289+0000","last_unstale":"2020-04-02T23:48:28.613952+0000","last_undegraded":"2020-04-02T23:48:28.613952+0000","last_fullsized":"2020-04-02T23:48:28.613952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.530949+0000","last_change":"2020-04-02T23:48:20.930956+0000","last_active":"2020-04-02T23:48:28.530949+0000","last_peered":"2020-04-02T23:48:28.530949+0000","last_clean":"2020-04-02T23:48:28.530949+0000","last_became_active":"2020-04-02T23:48:20.918564+0000","last_became_peered":"2020-04-02T23:48:20.918564+0000","last_unstale":"2020-04-02T23:48:28.530949+0000","last_undegraded":"2020-04-02T23:48:28.530949+0000","last_fullsized":"2020-04-02T23:48:28.530949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.187677+0000","last_change":"2020-04-02T23:48:24.870538+0000","last_active":"2020-04-02T23:48:28.187677+0000","last_peered":"2020-04-02T23:48:28.187677+0000","last_clean":"2020-04-02T23:48:28.187677+0000","last_became_active":"2020-04-02T23:48:24.858149+0000","last_became_peered":"2020-04-02T23:48:24.858149+0000","last_unstale":"2020-04-02T23:48:28.187677+0000","last_undegraded":"2020-04-02T23:48:28.187677+0000","last_fullsized":"2020-04-02T23:48:28.187677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.601418+0000","last_change":"2020-04-02T23:48:28.588723+0000","last_active":"2020-04-02T23:48:28.601418+0000","last_peered":"2020-04-02T23:48:28.601418+0000","last_clean":"2020-04-02T23:48:28.601418+0000","last_became_active":"2020-04-02T23:48:28.565058+0000","last_became_peered":"2020-04-02T23:48:28.565058+0000","last_unstale":"2020-04-02T23:48:28.601418+0000","last_undegraded":"2020-04-02T23:48:28.601418+0000","last_fullsized":"2020-04-02T23:48:28.601418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.000205+0000","last_change":"2020-04-02T23:48:24.878067+0000","last_active":"2020-04-02T23:48:28.000205+0000","last_peered":"2020-04-02T23:48:28.000205+0000","last_clean":"2020-04-02T23:48:28.000205+0000","last_became_active":"2020-04-02T23:48:24.832015+0000","last_became_peered":"2020-04-02T23:48:24.832015+0000","last_unstale":"2020-04-02T23:48:28.000205+0000","last_undegraded":"2020-04-02T23:48:28.000205+0000","last_fullsized":"2020-04-02T23:48:28.000205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.219885+0000","last_change":"2020-04-02T23:48:20.513735+0000","last_active":"2020-04-02T23:48:28.219885+0000","last_peered":"2020-04-02T23:48:28.219885+0000","last_clean":"2020-04-02T23:48:28.219885+0000","last_became_active":"2020-04-02T23:48:20.489917+0000","last_became_peered":"2020-04-02T23:48:20.489917+0000","last_unstale":"2020-04-02T23:48:28.219885+0000","last_undegraded":"2020-04-02T23:48:28.219885+0000","last_fullsized":"2020-04-02T23:48:28.219885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.575087+0000","last_change":"2020-04-02T23:48:28.561771+0000","last_active":"2020-04-02T23:48:28.575087+0000","last_peered":"2020-04-02T23:48:28.575087+0000","last_clean":"2020-04-02T23:48:28.575087+0000","last_became_active":"2020-04-02T23:48:28.531450+0000","last_became_peered":"2020-04-02T23:48:28.531450+0000","last_unstale":"2020-04-02T23:48:28.575087+0000","last_undegraded":"2020-04-02T23:48:28.575087+0000","last_fullsized":"2020-04-02T23:48:28.575087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.991538+0000","last_change":"2020-04-02T23:48:20.402414+0000","last_active":"2020-04-02T23:48:27.991538+0000","last_peered":"2020-04-02T23:48:27.991538+0000","last_clean":"2020-04-02T23:48:27.991538+0000","last_became_active":"2020-04-02T23:48:20.358596+0000","last_became_peered":"2020-04-02T23:48:20.358596+0000","last_unstale":"2020-04-02T23:48:27.991538+0000","last_undegraded":"2020-04-02T23:48:27.991538+0000","last_fullsized":"2020-04-02T23:48:27.991538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.178234+0000","last_change":"2020-04-02T23:48:24.878810+0000","last_active":"2020-04-02T23:48:28.178234+0000","last_peered":"2020-04-02T23:48:28.178234+0000","last_clean":"2020-04-02T23:48:28.178234+0000","last_became_active":"2020-04-02T23:48:24.835941+0000","last_became_peered":"2020-04-02T23:48:24.835941+0000","last_unstale":"2020-04-02T23:48:28.178234+0000","last_undegraded":"2020-04-02T23:48:28.178234+0000","last_fullsized":"2020-04-02T23:48:28.178234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":71.606999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.556}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.741}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.473000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.170999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.007999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3259999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.066000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.015000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.462999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.68}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.863}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6310000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.554}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.342000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.423999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.696}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.213999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.379999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.891}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5839999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.228999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.036999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.467000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.204999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.553999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7370000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4339999999999993}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.384}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.131}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7810000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.532}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":48.323999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9820000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.152000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.292999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0760000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.888999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.745999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.719999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3840000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7789999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.215}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.994}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6539999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.4379999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.977}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.391999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.827}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.919}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.754000000000001}]}]}]}} 2020-04-02T23:48:45.371 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:45.397 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:48:45.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.584+0000 7ff6c77da700 1 Processor -- start 2020-04-02T23:48:45.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.584+0000 7ff6c77da700 1 -- start start 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6c005be60 0x7ff6c00a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6c00a5030 0x7ff6c00a5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00a7660 con 0x7ff6c00a5030 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00a7840 con 0x7ff6c005be60 2020-04-02T23:48:45.587 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.585+0000 7ff6c77da700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00a7ae0 con 0x7ff6c013a8e0 2020-04-02T23:48:45.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.587+0000 7ff6c5d77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.587+0000 7ff6c5d77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46806/0 (socket says 172.21.15.190:46806) 2020-04-02T23:48:45.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.587+0000 7ff6c5d77700 1 -- 172.21.15.190:0/754180028 learned_addr learned my addr 172.21.15.190:0/754180028 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:45.612 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.610+0000 7ff6c5576700 1 --2- 172.21.15.190:0/754180028 >> v2:172.21.15.190:3300/0 conn(0x7ff6c005be60 0x7ff6c00a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.626 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 -- 172.21.15.190:0/754180028 >> v2:172.21.15.190:3300/0 conn(0x7ff6c005be60 msgr2=0x7ff6c00a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:45.626 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> v2:172.21.15.190:3300/0 conn(0x7ff6c005be60 0x7ff6c00a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:45.626 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 -- 172.21.15.190:0/754180028 >> v2:172.21.15.78:3300/0 conn(0x7ff6c00a5030 msgr2=0x7ff6c00a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:45.626 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> v2:172.21.15.78:3300/0 conn(0x7ff6c00a5030 0x7ff6c00a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:45.626 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 -- 172.21.15.190:0/754180028 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00a7290 con 0x7ff6c013a8e0 2020-04-02T23:48:45.627 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.624+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.628 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.627+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.627+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).ready entity=mon.2 client_cookie=ad8c0c4054c34b5a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:45.635 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6affff700 1 -- 172.21.15.190:0/754180028 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b800a160 con 0x7ff6c013a8e0 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6affff700 1 -- 172.21.15.190:0/754180028 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800a2c0 con 0x7ff6c013a8e0 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6affff700 1 -- 172.21.15.190:0/754180028 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b800a6a0 con 0x7ff6c013a8e0 2020-04-02T23:48:45.636 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6c77da700 1 -- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 msgr2=0x7ff6c013acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:45.637 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.633+0000 7ff6c77da700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7ff6b80032b0 tx=0x7ff6b8007dc0).stop 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.634+0000 7ff6c77da700 1 -- 172.21.15.190:0/754180028 shutdown_connections 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.634+0000 7ff6c77da700 1 --2- 172.21.15.190:0/754180028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c013acf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.634+0000 7ff6c77da700 1 --2- 172.21.15.190:0/754180028 >> v2:172.21.15.190:3300/0 conn(0x7ff6c005be60 0x7ff6c00a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.634+0000 7ff6c77da700 1 --2- 172.21.15.190:0/754180028 >> v2:172.21.15.78:3300/0 conn(0x7ff6c00a5030 0x7ff6c00a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.634+0000 7ff6c77da700 1 -- 172.21.15.190:0/754180028 >> 172.21.15.190:0/754180028 conn(0x7ff6c00634f0 msgr2=0x7ff6c005b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.635+0000 7ff6c77da700 1 -- 172.21.15.190:0/754180028 shutdown_connections 2020-04-02T23:48:45.638 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.635+0000 7ff6c77da700 1 -- 172.21.15.190:0/754180028 wait complete. 2020-04-02T23:48:45.639 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.636+0000 7ff6c77da700 1 Processor -- start 2020-04-02T23:48:45.639 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.636+0000 7ff6c77da700 1 -- start start 2020-04-02T23:48:45.642 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.637+0000 7ff6c77da700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6c00a5030 0x7ff6c0144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:45.642 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.637+0000 7ff6c77da700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c01451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:45.642 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.637+0000 7ff6c77da700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c0064900 con 0x7ff6c005be60 2020-04-02T23:48:45.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.637+0000 7ff6c77da700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c0065f50 con 0x7ff6c00a5030 2020-04-02T23:48:45.643 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.637+0000 7ff6c77da700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0064660 con 0x7ff6c013a8e0 2020-04-02T23:48:45.644 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.638+0000 7ff6c4d75700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6c00a5030 0x7ff6c0144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.644 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.638+0000 7ff6c5576700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff6c005be60 0x7ff6c0063dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54176/0 (socket says 172.21.15.190:54176) 2020-04-02T23:48:45.644 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.638+0000 7ff6c5576700 1 -- 172.21.15.190:0/1012591519 learned_addr learned my addr 172.21.15.190:0/1012591519 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:45.644 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.640+0000 7ff6c5d77700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c01451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.645 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.642+0000 7ff6c4d75700 1 -- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 msgr2=0x7ff6c01451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:45.645 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.642+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c01451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:45.645 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.642+0000 7ff6c4d75700 1 -- 172.21.15.190:0/1012591519 >> v1:172.21.15.190:6789/0 conn(0x7ff6c005be60 legacy=0x7ff6c0063dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:45.645 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.642+0000 7ff6c4d75700 1 -- 172.21.15.190:0/1012591519 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c01448d0 con 0x7ff6c00a5030 2020-04-02T23:48:45.646 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.644+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> v2:172.21.15.190:3300/0 conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.650 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.649+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> v2:172.21.15.190:3300/0 conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.651 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.649+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:45.659 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.659 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.659 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.660 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b0007540 con 0x7ff6c00a5030 2020-04-02T23:48:45.660 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00059e0 con 0x7ff6c00a5030 2020-04-02T23:48:45.660 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6b0005e00 con 0x7ff6c00a5030 2020-04-02T23:48:45.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0145630 con 0x7ff6c00a5030 2020-04-02T23:48:45.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.656+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01332a0 con 0x7ff6c00a5030 2020-04-02T23:48:45.661 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.657+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0056ec0 con 0x7ff6c00a5030 2020-04-02T23:48:45.908 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.905+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.908 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.905+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff6b0008950 con 0x7ff6c00a5030 2020-04-02T23:48:45.909 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.905+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6c4d75700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6ae7fc700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff6b0060eb0 con 0x7ff6c00a5030 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff6b00611d0 con 0x7ff6c00a5030 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6c5576700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:45.910 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6c5576700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6c0133c60 tx=0x7ff6bc002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.911 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6c5576700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6c0133c60 tx=0x7ff6bc002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:45.911 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:45.906+0000 7ff6c5576700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff6c0133c60 tx=0x7ff6bc002380).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.042 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.039+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 --> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6c0144ad0 con 0x7ff6a804d520 2020-04-02T23:48:46.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.043+0000 7ff6c5576700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7ff6c0133c60 tx=0x7ff6bc002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.043+0000 7ff6ae7fc700 1 -- 172.21.15.190:0/1012591519 <== mgr.4105 v2:172.21.15.78:6800/24250 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82180 (secure 0 0 0) 0x7ff6bc007300 con 0x7ff6a804d520 2020-04-02T23:48:46.047 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 msgr2=0x7ff6a804fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff6c0133c60 tx=0x7ff6bc002380).stop 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 msgr2=0x7ff6c0144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7ff6b0002f30 tx=0x7ff6b0010900).stop 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 shutdown_connections 2020-04-02T23:48:46.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7ff6a804d520 0x7ff6a804fa30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c013a8e0 0x7ff6c01451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 --2- 172.21.15.190:0/1012591519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c00a5030 0x7ff6c0144d70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 >> 172.21.15.190:0/1012591519 conn(0x7ff6c00634f0 msgr2=0x7ff6c006a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 shutdown_connections 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.044+0000 7ff6c77da700 1 -- 172.21.15.190:0/1012591519 wait complete. 2020-04-02T23:48:46.050 INFO:teuthology.orchestra.run.smithi190.stderr:dumped all 2020-04-02T23:48:46.057 INFO:teuthology.orchestra.run.smithi190.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2020-04-02T23:48:45.457923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390880,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583840,"statfs":{"total":773094113280,"available":764501852160,"internally_reserved":8589934592,"allocated":2260992,"data_stored":910712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.415856+0000","last_change":"2020-04-02T23:48:28.381231+0000","last_active":"2020-04-02T23:48:28.415856+0000","last_peered":"2020-04-02T23:48:28.415856+0000","last_clean":"2020-04-02T23:48:28.415856+0000","last_became_active":"2020-04-02T23:48:28.357043+0000","last_became_peered":"2020-04-02T23:48:28.357043+0000","last_unstale":"2020-04-02T23:48:28.415856+0000","last_undegraded":"2020-04-02T23:48:28.415856+0000","last_fullsized":"2020-04-02T23:48:28.415856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.179181+0000","last_change":"2020-04-02T23:48:20.940783+0000","last_active":"2020-04-02T23:48:28.179181+0000","last_peered":"2020-04-02T23:48:28.179181+0000","last_clean":"2020-04-02T23:48:28.179181+0000","last_became_active":"2020-04-02T23:48:20.924170+0000","last_became_peered":"2020-04-02T23:48:20.924170+0000","last_unstale":"2020-04-02T23:48:28.179181+0000","last_undegraded":"2020-04-02T23:48:28.179181+0000","last_fullsized":"2020-04-02T23:48:28.179181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.978563+0000","last_change":"2020-04-02T23:48:24.856124+0000","last_active":"2020-04-02T23:48:27.978563+0000","last_peered":"2020-04-02T23:48:27.978563+0000","last_clean":"2020-04-02T23:48:27.978563+0000","last_became_active":"2020-04-02T23:48:24.781557+0000","last_became_peered":"2020-04-02T23:48:24.781557+0000","last_unstale":"2020-04-02T23:48:27.978563+0000","last_undegraded":"2020-04-02T23:48:27.978563+0000","last_fullsized":"2020-04-02T23:48:27.978563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.516529+0000","last_change":"2020-04-02T23:48:28.494014+0000","last_active":"2020-04-02T23:48:28.516529+0000","last_peered":"2020-04-02T23:48:28.516529+0000","last_clean":"2020-04-02T23:48:28.516529+0000","last_became_active":"2020-04-02T23:48:28.481678+0000","last_became_peered":"2020-04-02T23:48:28.481678+0000","last_unstale":"2020-04-02T23:48:28.516529+0000","last_undegraded":"2020-04-02T23:48:28.516529+0000","last_fullsized":"2020-04-02T23:48:28.516529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.964719+0000","last_change":"2020-04-02T23:48:20.442132+0000","last_active":"2020-04-02T23:48:27.964719+0000","last_peered":"2020-04-02T23:48:27.964719+0000","last_clean":"2020-04-02T23:48:27.964719+0000","last_became_active":"2020-04-02T23:48:20.410561+0000","last_became_peered":"2020-04-02T23:48:20.410561+0000","last_unstale":"2020-04-02T23:48:27.964719+0000","last_undegraded":"2020-04-02T23:48:27.964719+0000","last_fullsized":"2020-04-02T23:48:27.964719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.086276+0000","last_change":"2020-04-02T23:48:24.962512+0000","last_active":"2020-04-02T23:48:28.086276+0000","last_peered":"2020-04-02T23:48:28.086276+0000","last_clean":"2020-04-02T23:48:28.086276+0000","last_became_active":"2020-04-02T23:48:24.922915+0000","last_became_peered":"2020-04-02T23:48:24.922915+0000","last_unstale":"2020-04-02T23:48:28.086276+0000","last_undegraded":"2020-04-02T23:48:28.086276+0000","last_fullsized":"2020-04-02T23:48:28.086276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.424333+0000","last_change":"2020-04-02T23:48:28.406614+0000","last_active":"2020-04-02T23:48:28.424333+0000","last_peered":"2020-04-02T23:48:28.424333+0000","last_clean":"2020-04-02T23:48:28.424333+0000","last_became_active":"2020-04-02T23:48:28.341042+0000","last_became_peered":"2020-04-02T23:48:28.341042+0000","last_unstale":"2020-04-02T23:48:28.424333+0000","last_undegraded":"2020-04-02T23:48:28.424333+0000","last_fullsized":"2020-04-02T23:48:28.424333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.449208+0000","last_change":"2020-04-02T23:48:20.647593+0000","last_active":"2020-04-02T23:48:28.449208+0000","last_peered":"2020-04-02T23:48:28.449208+0000","last_clean":"2020-04-02T23:48:28.449208+0000","last_became_active":"2020-04-02T23:48:20.603105+0000","last_became_peered":"2020-04-02T23:48:20.603105+0000","last_unstale":"2020-04-02T23:48:28.449208+0000","last_undegraded":"2020-04-02T23:48:28.449208+0000","last_fullsized":"2020-04-02T23:48:28.449208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.161493+0000","last_change":"2020-04-02T23:48:24.887433+0000","last_active":"2020-04-02T23:48:28.161493+0000","last_peered":"2020-04-02T23:48:28.161493+0000","last_clean":"2020-04-02T23:48:28.161493+0000","last_became_active":"2020-04-02T23:48:24.861509+0000","last_became_peered":"2020-04-02T23:48:24.861509+0000","last_unstale":"2020-04-02T23:48:28.161493+0000","last_undegraded":"2020-04-02T23:48:28.161493+0000","last_fullsized":"2020-04-02T23:48:28.161493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.642013+0000","last_change":"2020-04-02T23:48:28.609925+0000","last_active":"2020-04-02T23:48:28.642013+0000","last_peered":"2020-04-02T23:48:28.642013+0000","last_clean":"2020-04-02T23:48:28.642013+0000","last_became_active":"2020-04-02T23:48:28.583904+0000","last_became_peered":"2020-04-02T23:48:28.583904+0000","last_unstale":"2020-04-02T23:48:28.642013+0000","last_undegraded":"2020-04-02T23:48:28.642013+0000","last_fullsized":"2020-04-02T23:48:28.642013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.972281+0000","last_change":"2020-04-02T23:48:20.463644+0000","last_active":"2020-04-02T23:48:27.972281+0000","last_peered":"2020-04-02T23:48:27.972281+0000","last_clean":"2020-04-02T23:48:27.972281+0000","last_became_active":"2020-04-02T23:48:20.375230+0000","last_became_peered":"2020-04-02T23:48:20.375230+0000","last_unstale":"2020-04-02T23:48:27.972281+0000","last_undegraded":"2020-04-02T23:48:27.972281+0000","last_fullsized":"2020-04-02T23:48:27.972281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.516733+0000","last_change":"2020-04-02T23:48:15.780143+0000","last_active":"2020-04-02T23:48:28.516733+0000","last_peered":"2020-04-02T23:48:28.516733+0000","last_clean":"2020-04-02T23:48:28.516733+0000","last_became_active":"2020-04-02T23:48:15.749978+0000","last_became_peered":"2020-04-02T23:48:15.749978+0000","last_unstale":"2020-04-02T23:48:28.516733+0000","last_undegraded":"2020-04-02T23:48:28.516733+0000","last_fullsized":"2020-04-02T23:48:28.516733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:28.612987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:28.612987+0000","last_clean_scrub_stamp":"2020-04-02T23:47:28.612987+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.985192+0000","last_change":"2020-04-02T23:48:24.933551+0000","last_active":"2020-04-02T23:48:27.985192+0000","last_peered":"2020-04-02T23:48:27.985192+0000","last_clean":"2020-04-02T23:48:27.985192+0000","last_became_active":"2020-04-02T23:48:24.918724+0000","last_became_peered":"2020-04-02T23:48:24.918724+0000","last_unstale":"2020-04-02T23:48:27.985192+0000","last_undegraded":"2020-04-02T23:48:27.985192+0000","last_fullsized":"2020-04-02T23:48:27.985192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.652319+0000","last_change":"2020-04-02T23:48:28.623804+0000","last_active":"2020-04-02T23:48:28.652319+0000","last_peered":"2020-04-02T23:48:28.652319+0000","last_clean":"2020-04-02T23:48:28.652319+0000","last_became_active":"2020-04-02T23:48:28.596644+0000","last_became_peered":"2020-04-02T23:48:28.596644+0000","last_unstale":"2020-04-02T23:48:28.652319+0000","last_undegraded":"2020-04-02T23:48:28.652319+0000","last_fullsized":"2020-04-02T23:48:28.652319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.518998+0000","last_change":"2020-04-02T23:48:20.419692+0000","last_active":"2020-04-02T23:48:28.518998+0000","last_peered":"2020-04-02T23:48:28.518998+0000","last_clean":"2020-04-02T23:48:28.518998+0000","last_became_active":"2020-04-02T23:48:20.389688+0000","last_became_peered":"2020-04-02T23:48:20.389688+0000","last_unstale":"2020-04-02T23:48:28.518998+0000","last_undegraded":"2020-04-02T23:48:28.518998+0000","last_fullsized":"2020-04-02T23:48:28.518998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.139646+0000","last_change":"2020-04-02T23:48:24.914910+0000","last_active":"2020-04-02T23:48:28.139646+0000","last_peered":"2020-04-02T23:48:28.139646+0000","last_clean":"2020-04-02T23:48:28.139646+0000","last_became_active":"2020-04-02T23:48:24.902034+0000","last_became_peered":"2020-04-02T23:48:24.902034+0000","last_unstale":"2020-04-02T23:48:28.139646+0000","last_undegraded":"2020-04-02T23:48:28.139646+0000","last_fullsized":"2020-04-02T23:48:28.139646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.613952+0000","last_change":"2020-04-02T23:48:28.560530+0000","last_active":"2020-04-02T23:48:28.613952+0000","last_peered":"2020-04-02T23:48:28.613952+0000","last_clean":"2020-04-02T23:48:28.613952+0000","last_became_active":"2020-04-02T23:48:28.532289+0000","last_became_peered":"2020-04-02T23:48:28.532289+0000","last_unstale":"2020-04-02T23:48:28.613952+0000","last_undegraded":"2020-04-02T23:48:28.613952+0000","last_fullsized":"2020-04-02T23:48:28.613952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.530949+0000","last_change":"2020-04-02T23:48:20.930956+0000","last_active":"2020-04-02T23:48:28.530949+0000","last_peered":"2020-04-02T23:48:28.530949+0000","last_clean":"2020-04-02T23:48:28.530949+0000","last_became_active":"2020-04-02T23:48:20.918564+0000","last_became_peered":"2020-04-02T23:48:20.918564+0000","last_unstale":"2020-04-02T23:48:28.530949+0000","last_undegraded":"2020-04-02T23:48:28.530949+0000","last_fullsized":"2020-04-02T23:48:28.530949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.187677+0000","last_change":"2020-04-02T23:48:24.870538+0000","last_active":"2020-04-02T23:48:28.187677+0000","last_peered":"2020-04-02T23:48:28.187677+0000","last_clean":"2020-04-02T23:48:28.187677+0000","last_became_active":"2020-04-02T23:48:24.858149+0000","last_became_peered":"2020-04-02T23:48:24.858149+0000","last_unstale":"2020-04-02T23:48:28.187677+0000","last_undegraded":"2020-04-02T23:48:28.187677+0000","last_fullsized":"2020-04-02T23:48:28.187677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.601418+0000","last_change":"2020-04-02T23:48:28.588723+0000","last_active":"2020-04-02T23:48:28.601418+0000","last_peered":"2020-04-02T23:48:28.601418+0000","last_clean":"2020-04-02T23:48:28.601418+0000","last_became_active":"2020-04-02T23:48:28.565058+0000","last_became_peered":"2020-04-02T23:48:28.565058+0000","last_unstale":"2020-04-02T23:48:28.601418+0000","last_undegraded":"2020-04-02T23:48:28.601418+0000","last_fullsized":"2020-04-02T23:48:28.601418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.000205+0000","last_change":"2020-04-02T23:48:24.878067+0000","last_active":"2020-04-02T23:48:28.000205+0000","last_peered":"2020-04-02T23:48:28.000205+0000","last_clean":"2020-04-02T23:48:28.000205+0000","last_became_active":"2020-04-02T23:48:24.832015+0000","last_became_peered":"2020-04-02T23:48:24.832015+0000","last_unstale":"2020-04-02T23:48:28.000205+0000","last_undegraded":"2020-04-02T23:48:28.000205+0000","last_fullsized":"2020-04-02T23:48:28.000205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.219885+0000","last_change":"2020-04-02T23:48:20.513735+0000","last_active":"2020-04-02T23:48:28.219885+0000","last_peered":"2020-04-02T23:48:28.219885+0000","last_clean":"2020-04-02T23:48:28.219885+0000","last_became_active":"2020-04-02T23:48:20.489917+0000","last_became_peered":"2020-04-02T23:48:20.489917+0000","last_unstale":"2020-04-02T23:48:28.219885+0000","last_undegraded":"2020-04-02T23:48:28.219885+0000","last_fullsized":"2020-04-02T23:48:28.219885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.575087+0000","last_change":"2020-04-02T23:48:28.561771+0000","last_active":"2020-04-02T23:48:28.575087+0000","last_peered":"2020-04-02T23:48:28.575087+0000","last_clean":"2020-04-02T23:48:28.575087+0000","last_became_active":"2020-04-02T23:48:28.531450+0000","last_became_peered":"2020-04-02T23:48:28.531450+0000","last_unstale":"2020-04-02T23:48:28.575087+0000","last_undegraded":"2020-04-02T23:48:28.575087+0000","last_fullsized":"2020-04-02T23:48:28.575087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:26.727741+0000","last_clean_scrub_stamp":"2020-04-02T23:48:26.727741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:27.991538+0000","last_change":"2020-04-02T23:48:20.402414+0000","last_active":"2020-04-02T23:48:27.991538+0000","last_peered":"2020-04-02T23:48:27.991538+0000","last_clean":"2020-04-02T23:48:27.991538+0000","last_became_active":"2020-04-02T23:48:20.358596+0000","last_became_peered":"2020-04-02T23:48:20.358596+0000","last_unstale":"2020-04-02T23:48:27.991538+0000","last_undegraded":"2020-04-02T23:48:27.991538+0000","last_fullsized":"2020-04-02T23:48:27.991538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:18.841695+0000","last_clean_scrub_stamp":"2020-04-02T23:48:18.841695+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:48:28.178234+0000","last_change":"2020-04-02T23:48:24.878810+0000","last_active":"2020-04-02T23:48:28.178234+0000","last_peered":"2020-04-02T23:48:28.178234+0000","last_clean":"2020-04-02T23:48:28.178234+0000","last_became_active":"2020-04-02T23:48:24.835941+0000","last_became_peered":"2020-04-02T23:48:24.835941+0000","last_unstale":"2020-04-02T23:48:28.178234+0000","last_undegraded":"2020-04-02T23:48:28.178234+0000","last_fullsized":"2020-04-02T23:48:28.178234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:48:23.353427+0000","last_clean_scrub_stamp":"2020-04-02T23:48:23.353427+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476746,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0510000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.757}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.863}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.896000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.968}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.521999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3259999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.066000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.015000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.462999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.68}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.863}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6980000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.942}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6470000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.782}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.67}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.446}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.707999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2249999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.54}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.762}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.986000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.984999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.936}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.831}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8049999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.9930000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.206}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.412000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.933}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7679999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.558}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.122}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.253}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":50.868000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.120000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3840000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7789999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.215}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.994}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":113839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.319}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.620999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.806999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.505000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.663}]}]}]}} 2020-04-02T23:48:46.061 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-02T23:48:46.061 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-02T23:48:46.061 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-02T23:48:46.062 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:46.075 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-02T23:48:46.220 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.217+0000 7f12b1278700 1 Processor -- start 2020-04-02T23:48:46.220 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.217+0000 7f12b1278700 1 -- start start 2020-04-02T23:48:46.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12b1278700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:46.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12b1278700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12ac136470 0x7f12ac0a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:46.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12b1278700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac135c00 con 0x7f12ac136060 2020-04-02T23:48:46.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12b1278700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0a7a60 con 0x7f12ac136470 2020-04-02T23:48:46.221 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12b1278700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0a7f20 con 0x7f12ac0a7650 2020-04-02T23:48:46.222 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.218+0000 7f12aaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.222 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.219+0000 7f12ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12ac136470 0x7f12ac0a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.222 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.219+0000 7f12aaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46818/0 (socket says 172.21.15.190:46818) 2020-04-02T23:48:46.223 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.219+0000 7f12aaffd700 1 -- 172.21.15.190:0/1814020040 learned_addr learned my addr 172.21.15.190:0/1814020040 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:46.225 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.223+0000 7f12aaffd700 1 -- 172.21.15.190:0/1814020040 >> v2:172.21.15.78:3300/0 conn(0x7f12ac136470 msgr2=0x7f12ac0a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:46.225 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.223+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> v2:172.21.15.78:3300/0 conn(0x7f12ac136470 0x7f12ac0a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:46.225 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.223+0000 7f12aaffd700 1 -- 172.21.15.190:0/1814020040 >> v1:172.21.15.78:6789/0 conn(0x7f12ac136060 legacy=0x7f12ac0a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:46.226 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.223+0000 7f12aaffd700 1 -- 172.21.15.190:0/1814020040 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0a6990 con 0x7f12ac0a7650 2020-04-02T23:48:46.226 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.223+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.227 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.225+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.227 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.225+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).ready entity=mon.2 client_cookie=c9dfd0f2e2a21ece server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12a9ffb700 1 -- 172.21.15.190:0/1814020040 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a400ee90 con 0x7f12ac0a7650 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12a9ffb700 1 -- 172.21.15.190:0/1814020040 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4008e10 con 0x7f12ac0a7650 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12a9ffb700 1 -- 172.21.15.190:0/1814020040 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a4010350 con 0x7f12ac0a7650 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 -- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 msgr2=0x7f12ac0a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).stop 2020-04-02T23:48:46.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 -- 172.21.15.190:0/1814020040 shutdown_connections 2020-04-02T23:48:46.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 --2- 172.21.15.190:0/1814020040 >> v2:172.21.15.78:3300/0 conn(0x7f12ac136470 0x7f12ac0a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:46.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 --2- 172.21.15.190:0/1814020040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac0a6530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 -- 172.21.15.190:0/1814020040 >> 172.21.15.190:0/1814020040 conn(0x7f12ac06b360 msgr2=0x7f12ac0612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:46.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 -- 172.21.15.190:0/1814020040 shutdown_connections 2020-04-02T23:48:46.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.229+0000 7f12b1278700 1 -- 172.21.15.190:0/1814020040 wait complete. 2020-04-02T23:48:46.235 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.230+0000 7f12b1278700 1 Processor -- start 2020-04-02T23:48:46.235 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.230+0000 7f12b1278700 1 -- start start 2020-04-02T23:48:46.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12b1278700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12b1278700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f12ac136470 0x7f12ac065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12b1278700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac145030 con 0x7f12ac136060 2020-04-02T23:48:46.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12b1278700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac149350 con 0x7f12ac136470 2020-04-02T23:48:46.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12b1278700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac145290 con 0x7f12ac0a7650 2020-04-02T23:48:46.237 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12aa7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f12ac136060 0x7f12ac148940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36590/0 (socket says 172.21.15.190:36590) 2020-04-02T23:48:46.237 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.231+0000 7f12aa7fc700 1 -- 172.21.15.190:0/1080634842 learned_addr learned my addr 172.21.15.190:0/1080634842 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:46.237 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.232+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.232+0000 7f12ab7fe700 1 --2- 172.21.15.190:0/1080634842 >> v2:172.21.15.190:3300/0 conn(0x7f12ac136470 0x7f12ac065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.234+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308384889 0 0) 0x7f12ac145030 con 0x7f12ac136060 2020-04-02T23:48:46.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.234+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1288002fe0 con 0x7f12ac136060 2020-04-02T23:48:46.239 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.236+0000 7f12aaffd700 1 -- 172.21.15.190:0/1080634842 >> v2:172.21.15.190:3300/0 conn(0x7f12ac136470 msgr2=0x7f12ac065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.239 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.236+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> v2:172.21.15.190:3300/0 conn(0x7f12ac136470 0x7f12ac065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.239 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.236+0000 7f12aaffd700 1 -- 172.21.15.190:0/1080634842 >> v1:172.21.15.78:6789/0 conn(0x7f12ac136060 legacy=0x7f12ac148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.239 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.236+0000 7f12aaffd700 1 -- 172.21.15.190:0/1080634842 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac05be60 con 0x7f12ac0a7650 2020-04-02T23:48:46.239 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.236+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.239+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.239+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.246 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a400ea30 con 0x7f12ac0a7650 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400ee90 con 0x7f12ac0a7650 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12a4010a20 con 0x7f12ac0a7650 2020-04-02T23:48:46.247 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac149050 con 0x7f12ac0a7650 2020-04-02T23:48:46.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac145b90 con 0x7f12ac0a7650 2020-04-02T23:48:46.248 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.244+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac144e80 con 0x7f12ac0a7650 2020-04-02T23:48:46.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.423+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.426 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.423+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f12a4007160 con 0x7f12ac0a7650 2020-04-02T23:48:46.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.423+0000 7f129bfff700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.423+0000 7f12aa7fc700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.423+0000 7f12aa7fc700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12a00024b0 tx=0x7f12a0002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.424+0000 7f12aa7fc700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12a00024b0 tx=0x7f12a0002b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.427 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.424+0000 7f12aa7fc700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f12a00024b0 tx=0x7f12a0002b70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.424+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.428 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.424+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f12a403e780 con 0x7f12ac0a7650 2020-04-02T23:48:46.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.433+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.433+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f12a403c980 con 0x7f12ac0a7650 2020-04-02T23:48:46.622 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.619+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f12ac056ec0 con 0x7f12ac0a7650 2020-04-02T23:48:46.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.626+0000 7f12aaffd700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.629 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.626+0000 7f129bfff700 1 -- 172.21.15.190:0/1080634842 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f12a403ffa0 con 0x7f12ac0a7650 2020-04-02T23:48:46.629 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:46.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 msgr2=0x7f128804fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.631 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f12a00024b0 tx=0x7f12a0002b70).stop 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 msgr2=0x7f12ac145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f12ac0a0510 tx=0x7f12a4007a40).stop 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 shutdown_connections 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f128804d9b0 0x7f128804fec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 --2- 172.21.15.190:0/1080634842 >> v2:172.21.15.190:3300/0 conn(0x7f12ac136470 0x7f12ac065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 --2- 172.21.15.190:0/1080634842 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12ac0a7650 0x7f12ac145730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.632 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 >> 172.21.15.190:0/1080634842 conn(0x7f12ac06b360 msgr2=0x7f12ac0a6100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:46.633 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 shutdown_connections 2020-04-02T23:48:46.633 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.628+0000 7f12b1278700 1 -- 172.21.15.190:0/1080634842 wait complete. 2020-04-02T23:48:46.642 INFO:teuthology.orchestra.run.smithi190.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-02T23:48:46.643 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-02T23:48:46.643 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:46.656 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:46.810 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.805+0000 7f182e0df700 1 Processor -- start 2020-04-02T23:48:46.810 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.805+0000 7f182e0df700 1 -- start start 2020-04-02T23:48:46.810 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.806+0000 7f182e0df700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f182813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:46.810 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.806+0000 7f182e0df700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f182813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:46.810 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.806+0000 7f182e0df700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182813cfc0 con 0x7f18280ac4f0 2020-04-02T23:48:46.811 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.806+0000 7f182e0df700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1828067be0 con 0x7f18280677d0 2020-04-02T23:48:46.811 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.806+0000 7f182e0df700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182813d200 con 0x7f1828139ce0 2020-04-02T23:48:46.811 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.807+0000 7f18277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f182813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.811 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.807+0000 7f1827fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f182813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.807+0000 7f18277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f182813cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51848/0 (socket says 172.21.15.190:51848) 2020-04-02T23:48:46.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.807+0000 7f18277fe700 1 -- 172.21.15.190:0/2004093895 learned_addr learned my addr 172.21.15.190:0/2004093895 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:46.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.810+0000 7f18277fe700 1 -- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 msgr2=0x7f182813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:46.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.810+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f182813a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:46.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.810+0000 7f18277fe700 1 -- 172.21.15.190:0/2004093895 >> v1:172.21.15.190:6789/0 conn(0x7f18280ac4f0 legacy=0x7f18281395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:46.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.810+0000 7f18277fe700 1 -- 172.21.15.190:0/2004093895 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182813d4a0 con 0x7f18280677d0 2020-04-02T23:48:46.813 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.810+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f182805fc80 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.815 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.812+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f182805fc80 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.815 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.812+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f182805fc80 tx=0x7f1820007a40).ready entity=mon.0 client_cookie=486b6da7682bb9cd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.820 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f182805fc80 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.820 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f182805fc80 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.820 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18277fe700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f182805fc80 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18267fc700 1 -- 172.21.15.190:0/2004093895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820011630 con 0x7f18280677d0 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18267fc700 1 -- 172.21.15.190:0/2004093895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820011790 con 0x7f18280677d0 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f18267fc700 1 -- 172.21.15.190:0/2004093895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820011bb0 con 0x7f18280677d0 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f182e0df700 1 -- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 msgr2=0x7f182813cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.816+0000 7f182e0df700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f182805fc80 tx=0x7f1820007a40).stop 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 -- 172.21.15.190:0/2004093895 shutdown_connections 2020-04-02T23:48:46.821 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f182813a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:46.822 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 --2- 172.21.15.190:0/2004093895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f182813cb60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.822 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 -- 172.21.15.190:0/2004093895 >> 172.21.15.190:0/2004093895 conn(0x7f182805eff0 msgr2=0x7f182805f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:46.822 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 -- 172.21.15.190:0/2004093895 shutdown_connections 2020-04-02T23:48:46.822 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.817+0000 7f182e0df700 1 -- 172.21.15.190:0/2004093895 wait complete. 2020-04-02T23:48:46.823 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.818+0000 7f182e0df700 1 Processor -- start 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.818+0000 7f182e0df700 1 -- start start 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.819+0000 7f182e0df700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f18280a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.819+0000 7f182e0df700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f18280a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.819+0000 7f182e0df700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280a34a0 con 0x7f18280ac4f0 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.819+0000 7f182e0df700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280a2f60 con 0x7f18280677d0 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.819+0000 7f182e0df700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280a3200 con 0x7f1828139ce0 2020-04-02T23:48:46.824 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.820+0000 7f1827fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f18280a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.825 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.820+0000 7f18277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f18280a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.825 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.820+0000 7f18277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f18280a2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.190:51854/0 (socket says 172.21.15.190:51854) 2020-04-02T23:48:46.825 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.820+0000 7f18277fe700 1 -- 172.21.15.190:0/1566296083 learned_addr learned my addr 172.21.15.190:0/1566296083 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:46.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.823+0000 7f18277fe700 1 -- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 msgr2=0x7f18280a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.823+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f18280a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:46.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.823+0000 7f18277fe700 1 -- 172.21.15.190:0/1566296083 >> v1:172.21.15.190:6789/0 conn(0x7f18280ac4f0 legacy=0x7f1828132fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:46.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.824+0000 7f18277fe700 1 -- 172.21.15.190:0/1566296083 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18281336c0 con 0x7f18280677d0 2020-04-02T23:48:46.827 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.824+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.829 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.826+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> v2:172.21.15.78:3300/0 conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.829 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.826+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.831+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.831+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820011de0 con 0x7f18280677d0 2020-04-02T23:48:46.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.831+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18281371e0 con 0x7f18280677d0 2020-04-02T23:48:46.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.831+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828136580 con 0x7f18280677d0 2020-04-02T23:48:46.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.831+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182814a360 con 0x7f18280677d0 2020-04-02T23:48:46.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.834+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.836 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.834+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.834+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820007150 con 0x7f18280677d0 2020-04-02T23:48:46.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.834+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18200074b0 con 0x7f18280677d0 2020-04-02T23:48:46.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f18200056c0 con 0x7f18280677d0 2020-04-02T23:48:46.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1824ff9700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:46.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1826ffd700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:46.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1826ffd700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1810002fd0 tx=0x7f1810008880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1826ffd700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1810002fd0 tx=0x7f1810008880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.963+0000 7f1826ffd700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f1810002fd0 tx=0x7f1810008880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:46.969 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.967+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:46.969 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:46.967+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f18200407a0 con 0x7f18280677d0 2020-04-02T23:48:47.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.020+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.024 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.020+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f182003cb40 con 0x7f18280677d0 2020-04-02T23:48:47.161 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.158+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f182813cfc0 con 0x7f18280677d0 2020-04-02T23:48:47.191 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.189+0000 7f18277fe700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.192 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.189+0000 7f1824ff9700 1 -- 172.21.15.190:0/1566296083 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f182813cfc0 con 0x7f18280677d0 2020-04-02T23:48:47.192 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:47.192 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:47.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 msgr2=0x7f180c04fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.193 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f1810002fd0 tx=0x7f1810008880).stop 2020-04-02T23:48:47.194 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 msgr2=0x7f18280a2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f18280b0750 tx=0x7f1820007a40).stop 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 shutdown_connections 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f180c04d500 0x7f180c04fa10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828139ce0 0x7f18280a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 --2- 172.21.15.190:0/1566296083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280677d0 0x7f18280a2a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 >> 172.21.15.190:0/1566296083 conn(0x7f182805eff0 msgr2=0x7f18280abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:47.195 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 shutdown_connections 2020-04-02T23:48:47.196 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.190+0000 7f182e0df700 1 -- 172.21.15.190:0/1566296083 wait complete. 2020-04-02T23:48:47.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:27.771838+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:17.905670+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'21', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:22.984948+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:25.792553+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:48:47.204 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:47.218 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:48:47.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 Processor -- start 2020-04-02T23:48:47.366 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 -- start start 2020-04-02T23:48:47.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcde40a70a0 0x7fcde40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:47.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcde40a5820 0x7fcde40a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:47.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcde413a890 0x7fcde413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:47.367 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40a6090 con 0x7fcde40a5820 2020-04-02T23:48:47.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40a9b60 con 0x7fcde40a70a0 2020-04-02T23:48:47.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdec307700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40a5380 con 0x7fcde413a890 2020-04-02T23:48:47.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdea0a3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcde40a70a0 0x7fcde40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.368 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdea0a3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcde40a70a0 0x7fcde40a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60992/0 (socket says 172.21.15.190:60992) 2020-04-02T23:48:47.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdea0a3700 1 -- 172.21.15.190:0/2864478175 learned_addr learned my addr 172.21.15.190:0/2864478175 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:47.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcde413a890 0x7fcde413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.369 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.364+0000 7fcde98a2700 1 --2- 172.21.15.190:0/2864478175 >> v2:172.21.15.78:3300/0 conn(0x7fcde40a5820 0x7fcde40a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 -- 172.21.15.190:0/2864478175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcde413a890 msgr2=0x7fcde413aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:47.370 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcde413a890 0x7fcde413aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 -- 172.21.15.190:0/2864478175 >> v2:172.21.15.78:3300/0 conn(0x7fcde40a5820 msgr2=0x7fcde40a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:47.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> v2:172.21.15.78:3300/0 conn(0x7fcde40a5820 0x7fcde40a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 -- 172.21.15.190:0/2864478175 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40a98b0 con 0x7fcde40a70a0 2020-04-02T23:48:47.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.368+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> v2:172.21.15.190:3300/0 conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.370+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> v2:172.21.15.190:3300/0 conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.372 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.370+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).ready entity=mon.1 client_cookie=7ad0e95c67d013d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:47.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcde90a1700 1 -- 172.21.15.190:0/2864478175 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcddc011e30 con 0x7fcde40a70a0 2020-04-02T23:48:47.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcde90a1700 1 -- 172.21.15.190:0/2864478175 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00a160 con 0x7fcde40a70a0 2020-04-02T23:48:47.379 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcde90a1700 1 -- 172.21.15.190:0/2864478175 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcddc00a540 con 0x7fcde40a70a0 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcdec307700 1 -- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 msgr2=0x7fcde40a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.373+0000 7fcdec307700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fcddc0032b0 tx=0x7fcddc007dc0).stop 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 -- 172.21.15.190:0/2864478175 shutdown_connections 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcde413a890 0x7fcde413aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 --2- 172.21.15.190:0/2864478175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde40a70a0 0x7fcde40a9450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.380 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 --2- 172.21.15.190:0/2864478175 >> v2:172.21.15.78:3300/0 conn(0x7fcde40a5820 0x7fcde40a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.381 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 -- 172.21.15.190:0/2864478175 >> 172.21.15.190:0/2864478175 conn(0x7fcde405b3d0 msgr2=0x7fcde405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:47.381 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 -- 172.21.15.190:0/2864478175 shutdown_connections 2020-04-02T23:48:47.381 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.374+0000 7fcdec307700 1 -- 172.21.15.190:0/2864478175 wait complete. 2020-04-02T23:48:47.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.375+0000 7fcdec307700 1 Processor -- start 2020-04-02T23:48:47.382 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.375+0000 7fcdec307700 1 -- start start 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcdec307700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcde413a890 0x7fcde4136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcdec307700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde40a2fc0 con 0x7fcde40a5820 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcdec307700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde40a3260 con 0x7fcde40a70a0 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcdec307700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40a3500 con 0x7fcde413a890 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcde98a2700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fcde40a70a0 0x7fcde409d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54220/0 (socket says 172.21.15.190:54220) 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcde98a2700 1 -- 172.21.15.190:0/2259750923 learned_addr learned my addr 172.21.15.190:0/2259750923 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:47.383 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.377+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> v2:172.21.15.78:3300/0 conn(0x7fcde413a890 0x7fcde4136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.384 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.379+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869519408 0 0) 0x7fcde40a3260 con 0x7fcde40a70a0 2020-04-02T23:48:47.384 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.379+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4002fe0 con 0x7fcde40a70a0 2020-04-02T23:48:47.385 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.383+0000 7fcdea8a4700 1 -- 172.21.15.190:0/2259750923 >> v1:172.21.15.190:6789/0 conn(0x7fcde40a70a0 legacy=0x7fcde409d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.385 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.383+0000 7fcdea8a4700 1 -- 172.21.15.190:0/2259750923 >> v1:172.21.15.78:6789/0 conn(0x7fcde40a5820 legacy=0x7fcde40a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.383+0000 7fcdea8a4700 1 -- 172.21.15.190:0/2259750923 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde409dd70 con 0x7fcde413a890 2020-04-02T23:48:47.386 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.383+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> v2:172.21.15.78:3300/0 conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.388 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.386+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> v2:172.21.15.78:3300/0 conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.388 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.386+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:47.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd8007530 con 0x7fcde413a890 2020-04-02T23:48:47.392 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde40a2c40 con 0x7fcde413a890 2020-04-02T23:48:47.393 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde41368c0 con 0x7fcde413a890 2020-04-02T23:48:47.393 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.393 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.394 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd8013060 con 0x7fcde413a890 2020-04-02T23:48:47.394 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd80058b0 con 0x7fcde413a890 2020-04-02T23:48:47.394 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.390+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc0003340 con 0x7fcde413a890 2020-04-02T23:48:47.509 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcdd8005a10 con 0x7fcde413a890 2020-04-02T23:48:47.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdd77fe700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:47.510 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcde40a2b50 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcde40a2b50 tx=0x7fcddc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.507+0000 7fcdea0a3700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fcde40a2b50 tx=0x7fcddc007dc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:47.511 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.508+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.512 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.508+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcdd800f0a0 con 0x7fcde413a890 2020-04-02T23:48:47.603 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.601+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.604 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.601+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcdd803c460 con 0x7fcde413a890 2020-04-02T23:48:47.740 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.738+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcdc0002220 con 0x7fcde413a890 2020-04-02T23:48:47.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.754+0000 7fcdea8a4700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.756 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.754+0000 7fcdd77fe700 1 -- 172.21.15.190:0/2259750923 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcdd803fa80 con 0x7fcde413a890 2020-04-02T23:48:47.756 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 1 2020-04-02T23:48:47.757 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 msgr2=0x7fcdc404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fcde40a2b50 tx=0x7fcddc007dc0).stop 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 msgr2=0x7fcde4136b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fcdd8002f30 tx=0x7fcdd8010aa0).stop 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 shutdown_connections 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fcdc404d910 0x7fcdc404fe20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 --2- 172.21.15.190:0/2259750923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde413a890 0x7fcde4136b40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.758 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 >> 172.21.15.190:0/2259750923 conn(0x7fcde405b3d0 msgr2=0x7fcde4130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:47.759 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 shutdown_connections 2020-04-02T23:48:47.759 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.755+0000 7fcdec307700 1 -- 172.21.15.190:0/2259750923 wait complete. 2020-04-02T23:48:47.768 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:47.781 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:48:47.940 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.938+0000 7fd1860b2700 1 Processor -- start 2020-04-02T23:48:47.941 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.938+0000 7fd1860b2700 1 -- start start 2020-04-02T23:48:47.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd1860b2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1800a8af0 0x7fd180135ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:47.942 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd1860b2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a40f0 0x7fd180136310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:47.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd1860b2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800a8f00 con 0x7fd1800a28d0 2020-04-02T23:48:47.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd1860b2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd180135f20 con 0x7fd1800a8af0 2020-04-02T23:48:47.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd1860b2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800a2da0 con 0x7fd1800a40f0 2020-04-02T23:48:47.943 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd17f7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd1800a28d0 0x7fd1800a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54226/0 (socket says 172.21.15.190:54226) 2020-04-02T23:48:47.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.939+0000 7fd17f7fe700 1 -- 172.21.15.190:0/1246132224 learned_addr learned my addr 172.21.15.190:0/1246132224 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:47.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.940+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> v2:172.21.15.78:3300/0 conn(0x7fd1800a8af0 0x7fd180135ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.944 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.940+0000 7fd17ffff700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a40f0 0x7fd180136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17e7fc700 1 -- 172.21.15.190:0/1246132224 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094100164 0 0) 0x7fd1800a8f00 con 0x7fd1800a28d0 2020-04-02T23:48:47.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17e7fc700 1 -- 172.21.15.190:0/1246132224 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c003230 con 0x7fd1800a28d0 2020-04-02T23:48:47.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17effd700 1 -- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a40f0 msgr2=0x7fd180136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:47.945 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a40f0 0x7fd180136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.946 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17effd700 1 -- 172.21.15.190:0/1246132224 >> v1:172.21.15.190:6789/0 conn(0x7fd1800a28d0 legacy=0x7fd1800a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.946 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.942+0000 7fd17effd700 1 -- 172.21.15.190:0/1246132224 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1800a3040 con 0x7fd1800a8af0 2020-04-02T23:48:47.946 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.943+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> v2:172.21.15.78:3300/0 conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd174002f30 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.946 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.944+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> v2:172.21.15.78:3300/0 conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd174002f30 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.946 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.944+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fd174002f30 tx=0x7fd174007a40).ready entity=mon.0 client_cookie=1970439e4d0e0310 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:47.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd174002f30 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd174002f30 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17e7fc700 1 -- 172.21.15.190:0/1246132224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd174011310 con 0x7fd1800a8af0 2020-04-02T23:48:47.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17effd700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fd174002f30 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.951 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17e7fc700 1 -- 172.21.15.190:0/1246132224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174011470 con 0x7fd1800a8af0 2020-04-02T23:48:47.952 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd17e7fc700 1 -- 172.21.15.190:0/1246132224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd174011890 con 0x7fd1800a8af0 2020-04-02T23:48:47.952 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 -- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 msgr2=0x7fd180135ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.952 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fd174002f30 tx=0x7fd174007a40).stop 2020-04-02T23:48:47.953 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 -- 172.21.15.190:0/1246132224 shutdown_connections 2020-04-02T23:48:47.953 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a40f0 0x7fd180136310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:47.953 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 --2- 172.21.15.190:0/1246132224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1800a8af0 0x7fd180135ac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 -- 172.21.15.190:0/1246132224 >> 172.21.15.190:0/1246132224 conn(0x7fd18005b3d0 msgr2=0x7fd18005b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 -- 172.21.15.190:0/1246132224 shutdown_connections 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.949+0000 7fd1860b2700 1 -- 172.21.15.190:0/1246132224 wait complete. 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.950+0000 7fd1860b2700 1 Processor -- start 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.950+0000 7fd1860b2700 1 -- start start 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd1860b2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:47.954 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd1860b2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd180143ca0 con 0x7fd1800a40f0 2020-04-02T23:48:47.955 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd1860b2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18009d9d0 con 0x7fd1800a8af0 2020-04-02T23:48:47.955 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd1860b2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd180139a00 con 0x7fd1800a28d0 2020-04-02T23:48:47.955 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd17ffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd1800a8af0 0x7fd180143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54232/0 (socket says 172.21.15.190:54232) 2020-04-02T23:48:47.955 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.951+0000 7fd17ffff700 1 -- 172.21.15.190:0/2366360922 learned_addr learned my addr 172.21.15.190:0/2366360922 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:47.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.952+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.954+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671719735 0 0) 0x7fd18009d9d0 con 0x7fd1800a8af0 2020-04-02T23:48:47.956 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.954+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd160002fe0 con 0x7fd1800a8af0 2020-04-02T23:48:47.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.955+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004986092 0 0) 0x7fd180143ca0 con 0x7fd1800a40f0 2020-04-02T23:48:47.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.955+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd18009d9d0 con 0x7fd1800a40f0 2020-04-02T23:48:47.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.956+0000 7fd17f7fe700 1 -- 172.21.15.190:0/2366360922 >> v1:172.21.15.190:6789/0 conn(0x7fd1800a8af0 legacy=0x7fd180143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.956+0000 7fd17f7fe700 1 -- 172.21.15.190:0/2366360922 >> v1:172.21.15.78:6789/0 conn(0x7fd1800a40f0 legacy=0x7fd18009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:47.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.956+0000 7fd17f7fe700 1 -- 172.21.15.190:0/2366360922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180139b40 con 0x7fd1800a28d0 2020-04-02T23:48:47.959 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.957+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.959+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.961 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.959+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:47.965 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd170005cc0 con 0x7fd1800a28d0 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170005e20 con 0x7fd1800a28d0 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1700062b0 con 0x7fd1800a28d0 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18009e580 con 0x7fd1800a28d0 2020-04-02T23:48:47.966 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.963+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd180143990 con 0x7fd1800a28d0 2020-04-02T23:48:47.967 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.964+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18009e860 con 0x7fd1800a28d0 2020-04-02T23:48:47.979 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.977+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd170006410 con 0x7fd1800a28d0 2020-04-02T23:48:47.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17cff9700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:47.980 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17effd700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:47.981 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17effd700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd174007ed0 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.981 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17effd700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd174007ed0 tx=0x7fd174007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:47.981 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:47.978+0000 7fd17effd700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fd174007ed0 tx=0x7fd174007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:48.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.044+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.046 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.044+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd1700400f0 con 0x7fd1800a28d0 2020-04-02T23:48:48.153 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.151+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.154 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.151+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd17003c490 con 0x7fd1800a28d0 2020-04-02T23:48:48.292 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.290+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd18009e860 con 0x7fd1800a28d0 2020-04-02T23:48:48.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.294+0000 7fd17f7fe700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.294+0000 7fd17cff9700 1 -- 172.21.15.190:0/2366360922 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd18009e860 con 0x7fd1800a28d0 2020-04-02T23:48:48.296 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 msgr2=0x7fd16004ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fd174007ed0 tx=0x7fd174007a40).stop 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 msgr2=0x7fd18012e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd1700010d0 tx=0x7fd1700108e0).stop 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 shutdown_connections 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fd16004dac0 0x7fd16004ffd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:48.298 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 --2- 172.21.15.190:0/2366360922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1800a28d0 0x7fd18012e410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:48.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 >> 172.21.15.190:0/2366360922 conn(0x7fd18005b3d0 msgr2=0x7fd18012f190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:48.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 shutdown_connections 2020-04-02T23:48:48.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.295+0000 7fd1860b2700 1 -- 172.21.15.190:0/2366360922 wait complete. 2020-04-02T23:48:48.307 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:48.320 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:48:48.473 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.471+0000 7fc25359e700 1 Processor -- start 2020-04-02T23:48:48.474 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.471+0000 7fc25359e700 1 -- start start 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.472+0000 7fc25359e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2540a7430 0x7fc2540667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.472+0000 7fc25359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc254139d80 0x7fc25405f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.472+0000 7fc25359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc254066c00 con 0x7fc254139970 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.472+0000 7fc25359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc254139510 con 0x7fc254139d80 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.472+0000 7fc25359e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540670e0 con 0x7fc2540a7430 2020-04-02T23:48:48.475 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.473+0000 7fc25259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2540a7430 0x7fc2540667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:48.476 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.473+0000 7fc25259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2540a7430 0x7fc2540667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:32786/0 (socket says 172.21.15.190:32786) 2020-04-02T23:48:48.476 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.473+0000 7fc25259c700 1 -- 172.21.15.190:0/1343021698 learned_addr learned my addr 172.21.15.190:0/1343021698 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:48.476 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.473+0000 7fc252d9d700 1 --2- 172.21.15.190:0/1343021698 >> v2:172.21.15.78:3300/0 conn(0x7fc254139d80 0x7fc25405f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:48.478 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.476+0000 7fc25259c700 1 -- 172.21.15.190:0/1343021698 >> v2:172.21.15.78:3300/0 conn(0x7fc254139d80 msgr2=0x7fc25405f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:48.478 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.476+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> v2:172.21.15.78:3300/0 conn(0x7fc254139d80 0x7fc25405f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:48.478 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.476+0000 7fc25259c700 1 -- 172.21.15.190:0/1343021698 >> v1:172.21.15.78:6789/0 conn(0x7fc254139970 legacy=0x7fc25405eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.478 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.476+0000 7fc25259c700 1 -- 172.21.15.190:0/1343021698 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254066e40 con 0x7fc2540a7430 2020-04-02T23:48:48.479 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.477+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> v2:172.21.15.190:3300/0 conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc23c002f30 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.480 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.478+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> v2:172.21.15.190:3300/0 conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc23c002f30 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.480 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.478+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc23c002f30 tx=0x7fc23c007a40).ready entity=mon.1 client_cookie=fc9398c689db9218 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:48.484 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc23c002f30 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc23c002f30 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25259c700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fc23c002f30 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25159a700 1 -- 172.21.15.190:0/1343021698 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc23c011670 con 0x7fc2540a7430 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25159a700 1 -- 172.21.15.190:0/1343021698 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0117d0 con 0x7fc2540a7430 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25159a700 1 -- 172.21.15.190:0/1343021698 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc23c011bb0 con 0x7fc2540a7430 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25359e700 1 -- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 msgr2=0x7fc2540667a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.485 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.482+0000 7fc25359e700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fc23c002f30 tx=0x7fc23c007a40).stop 2020-04-02T23:48:48.486 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 -- 172.21.15.190:0/1343021698 shutdown_connections 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 --2- 172.21.15.190:0/1343021698 >> v2:172.21.15.78:3300/0 conn(0x7fc254139d80 0x7fc25405f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 --2- 172.21.15.190:0/1343021698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2540a7430 0x7fc2540667a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 -- 172.21.15.190:0/1343021698 >> 172.21.15.190:0/1343021698 conn(0x7fc254065a20 msgr2=0x7fc254060200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 -- 172.21.15.190:0/1343021698 shutdown_connections 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.483+0000 7fc25359e700 1 -- 172.21.15.190:0/1343021698 wait complete. 2020-04-02T23:48:48.487 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.484+0000 7fc25359e700 1 Processor -- start 2020-04-02T23:48:48.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.484+0000 7fc25359e700 1 -- start start 2020-04-02T23:48:48.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25359e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:48.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540a8dc0 con 0x7fc254139970 2020-04-02T23:48:48.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25359e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540a9060 con 0x7fc2540a7430 2020-04-02T23:48:48.488 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25359e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540a97a0 con 0x7fc254139d80 2020-04-02T23:48:48.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25259c700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc2540a7430 0x7fc2541379c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54240/0 (socket says 172.21.15.190:54240) 2020-04-02T23:48:48.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.485+0000 7fc25259c700 1 -- 172.21.15.190:0/2692377791 learned_addr learned my addr 172.21.15.190:0/2692377791 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:48.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.486+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:48.489 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.488+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533230833 0 0) 0x7fc2540a9060 con 0x7fc2540a7430 2020-04-02T23:48:48.490 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.488+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc238002fe0 con 0x7fc2540a7430 2020-04-02T23:48:48.490 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.488+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049063509 0 0) 0x7fc2540a8dc0 con 0x7fc254139970 2020-04-02T23:48:48.490 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.488+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2540a9060 con 0x7fc254139970 2020-04-02T23:48:48.492 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.490+0000 7fc252d9d700 1 -- 172.21.15.190:0/2692377791 >> v1:172.21.15.190:6789/0 conn(0x7fc2540a7430 legacy=0x7fc2541379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.492 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.490+0000 7fc252d9d700 1 -- 172.21.15.190:0/2692377791 >> v1:172.21.15.78:6789/0 conn(0x7fc254139970 legacy=0x7fc25412db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.492 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.490+0000 7fc252d9d700 1 -- 172.21.15.190:0/2692377791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540a9300 con 0x7fc254139d80 2020-04-02T23:48:48.492 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.490+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.492+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.494 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.492+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:48.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc24c012be0 con 0x7fc254139d80 2020-04-02T23:48:48.499 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c012d40 con 0x7fc254139d80 2020-04-02T23:48:48.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2541380d0 con 0x7fc254139d80 2020-04-02T23:48:48.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc24c00a350 con 0x7fc254139d80 2020-04-02T23:48:48.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.497+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2541322e0 con 0x7fc254139d80 2020-04-02T23:48:48.500 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.498+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc254056ec0 con 0x7fc254139d80 2020-04-02T23:48:48.514 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.512+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.514 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.512+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc24c00a5c0 con 0x7fc254139d80 2020-04-02T23:48:48.514 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.513+0000 7fc24b7fe700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:48.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.513+0000 7fc25259c700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:48.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.513+0000 7fc25259c700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc23c0082e0 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.513+0000 7fc25259c700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc23c0082e0 tx=0x7fc23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.513+0000 7fc25259c700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fc23c0082e0 tx=0x7fc23c007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:48.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.515+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.517 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.515+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc24c040f40 con 0x7fc254139d80 2020-04-02T23:48:48.689 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.687+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.689 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.687+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc24c03d2e0 con 0x7fc254139d80 2020-04-02T23:48:48.828 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.826+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc254069c00 con 0x7fc254139d80 2020-04-02T23:48:48.832 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.830+0000 7fc252d9d700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:48.832 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.830+0000 7fc24b7fe700 1 -- 172.21.15.190:0/2692377791 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc24c040900 con 0x7fc254139d80 2020-04-02T23:48:48.833 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:48.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 msgr2=0x7fc23804ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.834 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fc23c0082e0 tx=0x7fc23c007a40).stop 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 msgr2=0x7fc25412e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc24c0032b0 tx=0x7fc24c010f10).stop 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 shutdown_connections 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fc23804da20 0x7fc23804ff30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 --2- 172.21.15.190:0/2692377791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc254139d80 0x7fc25412e230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 >> 172.21.15.190:0/2692377791 conn(0x7fc254065a20 msgr2=0x7fc25413d690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 shutdown_connections 2020-04-02T23:48:48.835 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:48.832+0000 7fc25359e700 1 -- 172.21.15.190:0/2692377791 wait complete. 2020-04-02T23:48:48.844 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:48.858 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:48:49.007 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.005+0000 7f751a5b3700 1 Processor -- start 2020-04-02T23:48:49.008 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 -- start start 2020-04-02T23:48:49.008 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:49.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f751409f0d0 0x7f751409f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:49.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7514133c30 con 0x7f751409e720 2020-04-02T23:48:49.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751413cae0 con 0x7f751409f0d0 2020-04-02T23:48:49.009 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.006+0000 7f751a5b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751413cd80 con 0x7f75140aa930 2020-04-02T23:48:49.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.007+0000 7f7513fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.007+0000 7f7518b50700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f751409f0d0 0x7f751409f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.007+0000 7f7513fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46882/0 (socket says 172.21.15.190:46882) 2020-04-02T23:48:49.010 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.007+0000 7f7513fff700 1 -- 172.21.15.190:0/677715741 learned_addr learned my addr 172.21.15.190:0/677715741 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:49.012 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.010+0000 7f7513fff700 1 -- 172.21.15.190:0/677715741 >> v2:172.21.15.78:3300/0 conn(0x7f751409f0d0 msgr2=0x7f751409f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:49.012 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.010+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> v2:172.21.15.78:3300/0 conn(0x7f751409f0d0 0x7f751409f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:49.012 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.010+0000 7f7513fff700 1 -- 172.21.15.190:0/677715741 >> v1:172.21.15.78:6789/0 conn(0x7f751409e720 legacy=0x7f75141399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.012 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.010+0000 7f7513fff700 1 -- 172.21.15.190:0/677715741 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751413d020 con 0x7f75140aa930 2020-04-02T23:48:49.012 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.010+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.015 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.012+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.016 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.012+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).ready entity=mon.2 client_cookie=de5cf15f566518af server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.017 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.015+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.017 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.015+0000 7f75137fe700 1 -- 172.21.15.190:0/677715741 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7504011670 con 0x7f75140aa930 2020-04-02T23:48:49.018 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.016+0000 7f7513fff700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.019 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.016+0000 7f75137fe700 1 -- 172.21.15.190:0/677715741 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040117d0 con 0x7f75140aa930 2020-04-02T23:48:49.019 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 -- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 msgr2=0x7f751413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.019 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).stop 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 -- 172.21.15.190:0/677715741 shutdown_connections 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 --2- 172.21.15.190:0/677715741 >> v2:172.21.15.78:3300/0 conn(0x7f751409f0d0 0x7f751409f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 --2- 172.21.15.190:0/677715741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75140aa930 0x7f751413d4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 -- 172.21.15.190:0/677715741 >> 172.21.15.190:0/677715741 conn(0x7f751405eff0 msgr2=0x7f751405f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 -- 172.21.15.190:0/677715741 shutdown_connections 2020-04-02T23:48:49.020 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.017+0000 7f751a5b3700 1 -- 172.21.15.190:0/677715741 wait complete. 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.018+0000 7f751a5b3700 1 Processor -- start 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.018+0000 7f751a5b3700 1 -- start start 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f751a5b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f751409e720 0x7f7514136010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f751a5b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f751a5b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75140b00b0 con 0x7f75140aa930 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f751a5b3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75140b0350 con 0x7f751409e720 2020-04-02T23:48:49.022 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f751a5b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75140afd30 con 0x7f751409f0d0 2020-04-02T23:48:49.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.019+0000 7f750bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.020+0000 7f7513fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f751409e720 0x7f7514136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.020+0000 7f750bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46886/0 (socket says 172.21.15.190:46886) 2020-04-02T23:48:49.023 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.020+0000 7f750bfff700 1 -- 172.21.15.190:0/900815713 learned_addr learned my addr 172.21.15.190:0/900815713 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:49.027 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.025+0000 7f750bfff700 1 -- 172.21.15.190:0/900815713 >> v2:172.21.15.78:3300/0 conn(0x7f751409e720 msgr2=0x7f7514136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.027 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.025+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> v2:172.21.15.78:3300/0 conn(0x7f751409e720 0x7f7514136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.027 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.025+0000 7f750bfff700 1 -- 172.21.15.190:0/900815713 >> v1:172.21.15.78:6789/0 conn(0x7f75140aa930 legacy=0x7f75140ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.027 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.025+0000 7f750bfff700 1 -- 172.21.15.190:0/900815713 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140adfd0 con 0x7f751409f0d0 2020-04-02T23:48:49.028 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.025+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.030 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.028+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.030 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.028+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.034 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.034 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.034 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.034 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74fc00cbf0 con 0x7f751409f0d0 2020-04-02T23:48:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00cd90 con 0x7f751409f0d0 2020-04-02T23:48:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75140af6c0 con 0x7f751409f0d0 2020-04-02T23:48:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74fc011180 con 0x7f751409f0d0 2020-04-02T23:48:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514136630 con 0x7f751409f0d0 2020-04-02T23:48:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.032+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75140ae220 con 0x7f751409f0d0 2020-04-02T23:48:49.168 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.166+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.169 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.167+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f74fc0064e0 con 0x7f751409f0d0 2020-04-02T23:48:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.167+0000 7f7511ffb700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.167+0000 7f7513fff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.167+0000 7f7513fff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.168+0000 7f7513fff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.170 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.168+0000 7f7513fff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.171+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.173 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.171+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f74fc03fdf0 con 0x7f751409f0d0 2020-04-02T23:48:49.228 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.226+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.226+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f74fc03c190 con 0x7f751409f0d0 2020-04-02T23:48:49.371 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.368+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7514133c30 con 0x7f751409f0d0 2020-04-02T23:48:49.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.372+0000 7f750bfff700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.374 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.372+0000 7f7511ffb700 1 -- 172.21.15.190:0/900815713 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7514133c30 con 0x7f751409f0d0 2020-04-02T23:48:49.375 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:49.376 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 msgr2=0x7f74f804fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f7504002f30 tx=0x7f751405afd0).stop 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 msgr2=0x7f7514132d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f75140aaf60 tx=0x7f74fc001e30).stop 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 shutdown_connections 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f74f804d540 0x7f74f804fa50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 --2- 172.21.15.190:0/900815713 >> v2:172.21.15.78:3300/0 conn(0x7f751409e720 0x7f7514136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.377 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 --2- 172.21.15.190:0/900815713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f751409f0d0 0x7f7514132d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 >> 172.21.15.190:0/900815713 conn(0x7f751405eff0 msgr2=0x7f751406a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:49.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 shutdown_connections 2020-04-02T23:48:49.378 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.374+0000 7f751a5b3700 1 -- 172.21.15.190:0/900815713 wait complete. 2020-04-02T23:48:49.387 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:49.402 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:48:49.549 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.547+0000 7fe02093a700 1 Processor -- start 2020-04-02T23:48:49.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.547+0000 7fe02093a700 1 -- start start 2020-04-02T23:48:49.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.548+0000 7fe02093a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:49.550 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.548+0000 7fe02093a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe01c0ac4f0 0x7fe01c1395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:49.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.548+0000 7fe02093a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c13cfc0 con 0x7fe01c139a30 2020-04-02T23:48:49.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.548+0000 7fe02093a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c067be0 con 0x7fe01c0ac4f0 2020-04-02T23:48:49.551 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.548+0000 7fe02093a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c13d200 con 0x7fe01c0677d0 2020-04-02T23:48:49.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.549+0000 7fe01a59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.549+0000 7fe01ad9d700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe01c139a30 0x7fe01c139e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54262/0 (socket says 172.21.15.190:54262) 2020-04-02T23:48:49.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.549+0000 7fe01ad9d700 1 -- 172.21.15.190:0/1437129063 learned_addr learned my addr 172.21.15.190:0/1437129063 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:49.552 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.549+0000 7fe019d9b700 1 --2- 172.21.15.190:0/1437129063 >> v2:172.21.15.190:3300/0 conn(0x7fe01c0ac4f0 0x7fe01c1395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.554 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.552+0000 7fe01a59c700 1 -- 172.21.15.190:0/1437129063 >> v2:172.21.15.190:3300/0 conn(0x7fe01c0ac4f0 msgr2=0x7fe01c1395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:49.554 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.552+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> v2:172.21.15.190:3300/0 conn(0x7fe01c0ac4f0 0x7fe01c1395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:49.554 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.552+0000 7fe01a59c700 1 -- 172.21.15.190:0/1437129063 >> v1:172.21.15.190:6789/0 conn(0x7fe01c139a30 legacy=0x7fe01c139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.554 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.552+0000 7fe01a59c700 1 -- 172.21.15.190:0/1437129063 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c13d4a0 con 0x7fe01c0677d0 2020-04-02T23:48:49.555 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.552+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.555 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.554+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.556 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.554+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).ready entity=mon.2 client_cookie=e4937df18c193c4 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.560 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01a59c700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01959a700 1 -- 172.21.15.190:0/1437129063 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0100113c0 con 0x7fe01c0677d0 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01959a700 1 -- 172.21.15.190:0/1437129063 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010011520 con 0x7fe01c0677d0 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe01959a700 1 -- 172.21.15.190:0/1437129063 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe010011940 con 0x7fe01c0677d0 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 -- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 msgr2=0x7fe01c13cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.561 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).stop 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 -- 172.21.15.190:0/1437129063 shutdown_connections 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 --2- 172.21.15.190:0/1437129063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c13cb60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 --2- 172.21.15.190:0/1437129063 >> v2:172.21.15.190:3300/0 conn(0x7fe01c0ac4f0 0x7fe01c1395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 -- 172.21.15.190:0/1437129063 >> 172.21.15.190:0/1437129063 conn(0x7fe01c05eff0 msgr2=0x7fe01c05f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 -- 172.21.15.190:0/1437129063 shutdown_connections 2020-04-02T23:48:49.562 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.558+0000 7fe02093a700 1 -- 172.21.15.190:0/1437129063 wait complete. 2020-04-02T23:48:49.563 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.559+0000 7fe02093a700 1 Processor -- start 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.559+0000 7fe02093a700 1 -- start start 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.560+0000 7fe02093a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.560+0000 7fe02093a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe01c139a30 0x7fe01c132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.560+0000 7fe02093a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c14a310 con 0x7fe01c0ac4f0 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.560+0000 7fe02093a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0a31f0 con 0x7fe01c139a30 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.560+0000 7fe02093a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0a3400 con 0x7fe01c0677d0 2020-04-02T23:48:49.564 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.561+0000 7fe01a59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.565 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.561+0000 7fe01a59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.190:46898/0 (socket says 172.21.15.190:46898) 2020-04-02T23:48:49.565 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.561+0000 7fe01a59c700 1 -- 172.21.15.190:0/2946997527 learned_addr learned my addr 172.21.15.190:0/2946997527 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:49.565 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.561+0000 7fe01ad9d700 1 --2- 172.21.15.190:0/2946997527 >> v2:172.21.15.78:3300/0 conn(0x7fe01c139a30 0x7fe01c132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.566 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.564+0000 7fe01a59c700 1 -- 172.21.15.190:0/2946997527 >> v2:172.21.15.78:3300/0 conn(0x7fe01c139a30 msgr2=0x7fe01c132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.567 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.564+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> v2:172.21.15.78:3300/0 conn(0x7fe01c139a30 0x7fe01c132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.567 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.565+0000 7fe01a59c700 1 -- 172.21.15.190:0/2946997527 >> v1:172.21.15.78:6789/0 conn(0x7fe01c0ac4f0 legacy=0x7fe01c14a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.567 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.565+0000 7fe01a59c700 1 -- 172.21.15.190:0/2946997527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0a24c0 con 0x7fe01c0677d0 2020-04-02T23:48:49.567 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.565+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.569 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.567+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.569 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.567+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.571 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.569+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.569+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0100118c0 con 0x7fe01c0677d0 2020-04-02T23:48:49.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.569+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c14aec0 con 0x7fe01c0677d0 2020-04-02T23:48:49.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.569+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0a2ef0 con 0x7fe01c0677d0 2020-04-02T23:48:49.572 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.571+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c0a2650 con 0x7fe01c0677d0 2020-04-02T23:48:49.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.587+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.587+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.587+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010007150 con 0x7fe01c0677d0 2020-04-02T23:48:49.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.587+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0100074f0 con 0x7fe01c0677d0 2020-04-02T23:48:49.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.587+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe0100056c0 con 0x7fe01c0677d0 2020-04-02T23:48:49.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe00b7fe700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:49.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe019d9b700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:49.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe019d9b700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe01c0a1e20 tx=0x7fe00c00c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.591 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe019d9b700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe01c0a1e20 tx=0x7fe00c00c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.592 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.588+0000 7fe019d9b700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fe01c0a1e20 tx=0x7fe00c00c780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:49.592 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.589+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.592 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.589+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe010040dc0 con 0x7fe01c0677d0 2020-04-02T23:48:49.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.764+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.764+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe01003d160 con 0x7fe01c0677d0 2020-04-02T23:48:49.958 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.956+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe01c14a4a0 con 0x7fe01c0677d0 2020-04-02T23:48:49.970 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.968+0000 7fe01a59c700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:49.971 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.969+0000 7fe00b7fe700 1 -- 172.21.15.190:0/2946997527 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fe010040780 con 0x7fe01c0677d0 2020-04-02T23:48:49.971 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:49.971 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.78:6835/368243036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":368243036},{"type":"v1","addr":"172.21.15.78:6835","nonce":368243036}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:48:28.761290+0000","modified":"2020-04-02T23:48:46.650056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4429":{"gid":4429,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6833/1548843936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":1548843936},{"type":"v1","addr":"172.21.15.190:6833","nonce":1548843936}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:48:49.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 msgr2=0x7fdff804fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fe01c0a1e20 tx=0x7fe00c00c780).stop 2020-04-02T23:48:49.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 msgr2=0x7fe01c0a2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:49.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fe010002f30 tx=0x7fe010007a40).stop 2020-04-02T23:48:49.973 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 shutdown_connections 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fdff804d530 0x7fdff804fa40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 --2- 172.21.15.190:0/2946997527 >> v2:172.21.15.78:3300/0 conn(0x7fe01c139a30 0x7fe01c132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 --2- 172.21.15.190:0/2946997527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe01c0677d0 0x7fe01c0a2850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 >> 172.21.15.190:0/2946997527 conn(0x7fe01c05eff0 msgr2=0x7fe01c13c770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 shutdown_connections 2020-04-02T23:48:49.974 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:49.970+0000 7fe02093a700 1 -- 172.21.15.190:0/2946997527 wait complete. 2020-04-02T23:48:49.975 INFO:teuthology.orchestra.run.smithi190.stderr:dumped fsmap epoch 6 2020-04-02T23:48:50.184 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4429}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4429': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4429, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1548843936, u'type': u'v2', u'addr': u'172.21.15.190:6832'}, {u'nonce': 1548843936, u'type': u'v1', u'addr': u'172.21.15.190:6833'}]}, u'addr': u'172.21.15.190:6833/1548843936'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:48:28.761290+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:48:46.650056+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:48:50.184 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:48:50.184 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:50.202 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:48:50.471 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2020-04-02T23:48:50.471 INFO:teuthology.orchestra.run.smithi190.stdout: "cluster_fsid": "01f4b530-6799-492e-8606-c311ffa25289", 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "whoami": 0, 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4429, 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "want_state": "up:active", 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "state": "up:active", 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "rank_uptime": 6.7596496640000003, 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "mdsmap_epoch": 6, 2020-04-02T23:48:50.472 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_epoch": 27, 2020-04-02T23:48:50.473 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_epoch_barrier": 27, 2020-04-02T23:48:50.473 INFO:teuthology.orchestra.run.smithi190.stdout: "uptime": 12.000707882 2020-04-02T23:48:50.473 INFO:teuthology.orchestra.run.smithi190.stdout:} 2020-04-02T23:48:50.480 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "01f4b530-6799-492e-8606-c311ffa25289", "whoami": 0, "id": 4429, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.7596496640000003, "mdsmap_epoch": 6, "osdmap_epoch": 27, "osdmap_epoch_barrier": 27, "uptime": 12.000707882 } 2020-04-02T23:48:50.481 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-04-02T23:48:50.499 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-04-02T23:48:50.499 INFO:tasks.ceph_fuse:config is None 2020-04-02T23:48:50.499 INFO:tasks.ceph_fuse:new config is {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}} 2020-04-02T23:48:50.500 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-04-02T23:48:50.500 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:50.513 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.660+0000 7fa020b38700 1 Processor -- start 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.660+0000 7fa020b38700 1 -- start start 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa020b38700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c09f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa020b38700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa01c139c00 0x7fa01c13a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa020b38700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c0a0130 con 0x7fa01c0ab680 2020-04-02T23:48:50.664 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa020b38700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0a8220 con 0x7fa01c0a7c30 2020-04-02T23:48:50.665 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa020b38700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c09f980 con 0x7fa01c139c00 2020-04-02T23:48:50.665 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.661+0000 7fa019d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa01c139c00 0x7fa01c13a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:50.665 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.662+0000 7fa019d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa01c139c00 0x7fa01c13a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:32820/0 (socket says 172.21.15.190:32820) 2020-04-02T23:48:50.665 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.662+0000 7fa019d9b700 1 -- 172.21.15.190:0/2862151328 learned_addr learned my addr 172.21.15.190:0/2862151328 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:50.667 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.662+0000 7fa01a59c700 1 --2- 172.21.15.190:0/2862151328 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c09f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:50.667 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.664+0000 7fa019d9b700 1 -- 172.21.15.190:0/2862151328 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 msgr2=0x7fa01c09f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:50.667 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.664+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c09f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:50.667 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.664+0000 7fa019d9b700 1 -- 172.21.15.190:0/2862151328 >> v1:172.21.15.78:6789/0 conn(0x7fa01c0ab680 legacy=0x7fa01c0aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:50.667 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.664+0000 7fa019d9b700 1 -- 172.21.15.190:0/2862151328 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c09fbf0 con 0x7fa01c139c00 2020-04-02T23:48:50.668 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.665+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> v2:172.21.15.190:3300/0 conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa00c002f30 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.668 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.666+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> v2:172.21.15.190:3300/0 conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa00c002f30 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.668 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.666+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fa00c002f30 tx=0x7fa00c007a40).ready entity=mon.1 client_cookie=f8054d9be84313a3 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:50.672 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fa00c002f30 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fa00c002f30 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa019d9b700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fa00c002f30 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa01959a700 1 -- 172.21.15.190:0/2862151328 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00c011670 con 0x7fa01c139c00 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa01959a700 1 -- 172.21.15.190:0/2862151328 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c0117d0 con 0x7fa01c139c00 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa01959a700 1 -- 172.21.15.190:0/2862151328 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00c011bb0 con 0x7fa01c139c00 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa020b38700 1 -- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 msgr2=0x7fa01c13a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:50.673 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.670+0000 7fa020b38700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fa00c002f30 tx=0x7fa00c007a40).stop 2020-04-02T23:48:50.675 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 -- 172.21.15.190:0/2862151328 shutdown_connections 2020-04-02T23:48:50.676 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 --2- 172.21.15.190:0/2862151328 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c09f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:50.676 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 --2- 172.21.15.190:0/2862151328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa01c139c00 0x7fa01c13a010 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:50.676 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 -- 172.21.15.190:0/2862151328 >> 172.21.15.190:0/2862151328 conn(0x7fa01c06b360 msgr2=0x7fa01c0612e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:50.676 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 -- 172.21.15.190:0/2862151328 shutdown_connections 2020-04-02T23:48:50.676 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.671+0000 7fa020b38700 1 -- 172.21.15.190:0/2862151328 wait complete. 2020-04-02T23:48:50.677 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.672+0000 7fa020b38700 1 Processor -- start 2020-04-02T23:48:50.677 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.672+0000 7fa020b38700 1 -- start start 2020-04-02T23:48:50.677 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa020b38700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:50.677 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa020b38700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa01c139c00 0x7fa01c063c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:50.678 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa020b38700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c1481f0 con 0x7fa01c0ab680 2020-04-02T23:48:50.678 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa020b38700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c064180 con 0x7fa01c0a7c30 2020-04-02T23:48:50.678 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa020b38700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c064420 con 0x7fa01c139c00 2020-04-02T23:48:50.679 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa019d9b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa01c0ab680 0x7fa01c129f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54280/0 (socket says 172.21.15.190:54280) 2020-04-02T23:48:50.679 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa019d9b700 1 -- 172.21.15.190:0/3835207617 learned_addr learned my addr 172.21.15.190:0/3835207617 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:50.679 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:50.679 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.673+0000 7fa01ad9d700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa01c139c00 0x7fa01c063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:50.680 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.676+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003444459 0 0) 0x7fa01c1481f0 con 0x7fa01c0ab680 2020-04-02T23:48:50.680 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.676+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa000002fe0 con 0x7fa01c0ab680 2020-04-02T23:48:50.680 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.677+0000 7fa01a59c700 1 -- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa01c139c00 msgr2=0x7fa01c063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:50.680 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.677+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa01c139c00 0x7fa01c063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:50.681 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.677+0000 7fa01a59c700 1 -- 172.21.15.190:0/3835207617 >> v1:172.21.15.190:6789/0 conn(0x7fa01c0ab680 legacy=0x7fa01c129f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:50.681 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.677+0000 7fa01a59c700 1 -- 172.21.15.190:0/3835207617 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c065890 con 0x7fa01c0a7c30 2020-04-02T23:48:50.681 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.678+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.682 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.680+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> v2:172.21.15.78:3300/0 conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.682 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.680+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa004007530 con 0x7fa01c0a7c30 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040056c0 con 0x7fa01c0a7c30 2020-04-02T23:48:50.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa004005ae0 con 0x7fa01c0a7c30 2020-04-02T23:48:50.688 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c12a610 con 0x7fa01c0a7c30 2020-04-02T23:48:50.688 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.684+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c0a4100 con 0x7fa01c0a7c30 2020-04-02T23:48:50.688 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.685+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c056ec0 con 0x7fa01c0a7c30 2020-04-02T23:48:50.701 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.700+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.702 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.700+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa004005c40 con 0x7fa01c0a7c30 2020-04-02T23:48:50.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.700+0000 7fa0137fe700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:50.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.701+0000 7fa019d9b700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:50.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.701+0000 7fa019d9b700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa00c0084c0 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.701+0000 7fa019d9b700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa00c0084c0 tx=0x7fa00c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.703 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.701+0000 7fa019d9b700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa00c0084c0 tx=0x7fa00c007a40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:50.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.702+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.705 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.702+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa00400d0c0 con 0x7fa01c0a7c30 2020-04-02T23:48:50.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.874+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:50.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:50.874+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa00403c780 con 0x7fa01c0a7c30 2020-04-02T23:48:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.013+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa01c05c3e0 con 0x7fa01c0a7c30 2020-04-02T23:48:51.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.042+0000 7fa01a59c700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.044 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.042+0000 7fa0137fe700 1 -- 172.21.15.190:0/3835207617 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fa00403fda0 con 0x7fa01c0a7c30 2020-04-02T23:48:51.045 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:51.045 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":27,"fsid":"01f4b530-6799-492e-8606-c311ffa25289","created":"2020-04-02T23:47:23.245853+0000","modified":"2020-04-02T23:48:28.750581+0000","last_up_change":"2020-04-02T23:48:14.421982+0000","last_in_change":"2020-04-02T23:48:14.421982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:47:27.771838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:48:17.905670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:48:22.984948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:48:25.792553+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88fad508-815e-46fa-ae41-723473e13722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":24459},{"type":"v1","addr":"172.21.15.190:6801","nonce":24459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":24459},{"type":"v1","addr":"172.21.15.190:6803","nonce":24459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":24459},{"type":"v1","addr":"172.21.15.190:6807","nonce":24459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":24459},{"type":"v1","addr":"172.21.15.190:6805","nonce":24459}]},"public_addr":"172.21.15.190:6801/24459","cluster_addr":"172.21.15.190:6803/24459","heartbeat_back_addr":"172.21.15.190:6807/24459","heartbeat_front_addr":"172.21.15.190:6805/24459","state":["exists","up"]},{"osd":1,"uuid":"30c511d9-8d3c-4014-ad39-2eb4dca528cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":24511},{"type":"v1","addr":"172.21.15.190:6809","nonce":24511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":24511},{"type":"v1","addr":"172.21.15.190:6811","nonce":24511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":24511},{"type":"v1","addr":"172.21.15.190:6815","nonce":24511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":24511},{"type":"v1","addr":"172.21.15.190:6813","nonce":24511}]},"public_addr":"172.21.15.190:6809/24511","cluster_addr":"172.21.15.190:6811/24511","heartbeat_back_addr":"172.21.15.190:6815/24511","heartbeat_front_addr":"172.21.15.190:6813/24511","state":["exists","up"]},{"osd":2,"uuid":"dba96313-2969-4c1c-a94e-dc7d84424926","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":24534},{"type":"v1","addr":"172.21.15.190:6817","nonce":24534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":24534},{"type":"v1","addr":"172.21.15.190:6819","nonce":24534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":24534},{"type":"v1","addr":"172.21.15.190:6823","nonce":24534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":24534},{"type":"v1","addr":"172.21.15.190:6821","nonce":24534}]},"public_addr":"172.21.15.190:6817/24534","cluster_addr":"172.21.15.190:6819/24534","heartbeat_back_addr":"172.21.15.190:6823/24534","heartbeat_front_addr":"172.21.15.190:6821/24534","state":["exists","up"]},{"osd":3,"uuid":"fb2e684a-97f1-49d3-8863-b5efd44ed407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":24546},{"type":"v1","addr":"172.21.15.190:6825","nonce":24546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":24546},{"type":"v1","addr":"172.21.15.190:6827","nonce":24546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":24546},{"type":"v1","addr":"172.21.15.190:6831","nonce":24546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":24546},{"type":"v1","addr":"172.21.15.190:6829","nonce":24546}]},"public_addr":"172.21.15.190:6825/24546","cluster_addr":"172.21.15.190:6827/24546","heartbeat_back_addr":"172.21.15.190:6831/24546","heartbeat_front_addr":"172.21.15.190:6829/24546","state":["exists","up"]},{"osd":4,"uuid":"3bae49af-72e5-4d0d-b009-ba9f1f1c9419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":25645},{"type":"v1","addr":"172.21.15.78:6803","nonce":25645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":25645},{"type":"v1","addr":"172.21.15.78:6805","nonce":25645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":25645},{"type":"v1","addr":"172.21.15.78:6809","nonce":25645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":25645},{"type":"v1","addr":"172.21.15.78:6807","nonce":25645}]},"public_addr":"172.21.15.78:6803/25645","cluster_addr":"172.21.15.78:6805/25645","heartbeat_back_addr":"172.21.15.78:6809/25645","heartbeat_front_addr":"172.21.15.78:6807/25645","state":["exists","up"]},{"osd":5,"uuid":"174e03aa-ba1e-4823-9c41-b07e17c28177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":25698},{"type":"v1","addr":"172.21.15.78:6819","nonce":25698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":25698},{"type":"v1","addr":"172.21.15.78:6821","nonce":25698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":25698},{"type":"v1","addr":"172.21.15.78:6825","nonce":25698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":25698},{"type":"v1","addr":"172.21.15.78:6823","nonce":25698}]},"public_addr":"172.21.15.78:6819/25698","cluster_addr":"172.21.15.78:6821/25698","heartbeat_back_addr":"172.21.15.78:6825/25698","heartbeat_front_addr":"172.21.15.78:6823/25698","state":["exists","up"]},{"osd":6,"uuid":"0dab7226-754e-4317-b2db-fa6a69451475","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":25716},{"type":"v1","addr":"172.21.15.78:6811","nonce":25716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":25716},{"type":"v1","addr":"172.21.15.78:6813","nonce":25716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":25716},{"type":"v1","addr":"172.21.15.78:6817","nonce":25716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":25716},{"type":"v1","addr":"172.21.15.78:6815","nonce":25716}]},"public_addr":"172.21.15.78:6811/25716","cluster_addr":"172.21.15.78:6813/25716","heartbeat_back_addr":"172.21.15.78:6817/25716","heartbeat_front_addr":"172.21.15.78:6815/25716","state":["exists","up"]},{"osd":7,"uuid":"df871ce6-4780-4a5f-9fe2-d513065e7595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":25729},{"type":"v1","addr":"172.21.15.78:6827","nonce":25729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":25729},{"type":"v1","addr":"172.21.15.78:6829","nonce":25729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":25729},{"type":"v1","addr":"172.21.15.78:6833","nonce":25729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":25729},{"type":"v1","addr":"172.21.15.78:6831","nonce":25729}]},"public_addr":"172.21.15.78:6827/25729","cluster_addr":"172.21.15.78:6829/25729","heartbeat_back_addr":"172.21.15.78:6833/25729","heartbeat_front_addr":"172.21.15.78:6831/25729","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.344798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.626347+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.584230+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.885699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.018543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.174890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:10.909202+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:48:11.071225+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.043+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 msgr2=0x7fa00004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa00c0084c0 tx=0x7fa00c007a40).stop 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 msgr2=0x7fa01c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fa004002f30 tx=0x7fa004010bb0).stop 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 shutdown_connections 2020-04-02T23:48:51.048 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa00004d910 0x7fa00004fe20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa01c139c00 0x7fa01c063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 --2- 172.21.15.190:0/3835207617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa01c0a7c30 0x7fa01c063800 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.049 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 >> 172.21.15.190:0/3835207617 conn(0x7fa01c06b360 msgr2=0x7fa01c061200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:51.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 shutdown_connections 2020-04-02T23:48:51.050 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.044+0000 7fa020b38700 1 -- 172.21.15.190:0/3835207617 wait complete. 2020-04-02T23:48:51.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:47:27.771838+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:17.905670+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'21', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:22.984948+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:48:25.792553+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'27', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:48:51.061 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:51.075 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:48:51.230 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.226+0000 7f63922aa700 1 Processor -- start 2020-04-02T23:48:51.230 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.226+0000 7f63922aa700 1 -- start start 2020-04-02T23:48:51.230 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f638c05cf70 0x7f638c0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c0a7f50 0x7f638c05b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05baa0 0x7f638c13cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c13c9d0 con 0x7f638c05cf70 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c05bfc0 con 0x7f638c05baa0 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f63922aa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c05c260 con 0x7f638c0a7f50 2020-04-02T23:48:51.231 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f6390847700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05baa0 0x7f638c13cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f638bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f638c05cf70 0x7f638c0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f6390847700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05baa0 0x7f638c13cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:32836/0 (socket says 172.21.15.190:32836) 2020-04-02T23:48:51.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f6390847700 1 -- 172.21.15.190:0/2114565927 learned_addr learned my addr 172.21.15.190:0/2114565927 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:51.232 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.227+0000 7f638b7fe700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c0a7f50 0x7f638c05b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 -- 172.21.15.190:0/2114565927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c0a7f50 msgr2=0x7f638c05b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:51.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c0a7f50 0x7f638c05b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 -- 172.21.15.190:0/2114565927 >> v2:172.21.15.78:3300/0 conn(0x7f638c05cf70 msgr2=0x7f638c0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:51.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> v2:172.21.15.78:3300/0 conn(0x7f638c05cf70 0x7f638c0a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.233 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 -- 172.21.15.190:0/2114565927 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0a7650 con 0x7f638c05baa0 2020-04-02T23:48:51.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.230+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> v2:172.21.15.190:3300/0 conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63840032b0 tx=0x7f6384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.231+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> v2:172.21.15.190:3300/0 conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63840032b0 tx=0x7f6384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.234 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.231+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f63840032b0 tx=0x7f6384007dc0).ready entity=mon.1 client_cookie=1674a7162f3928b1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:51.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.234+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f63840032b0 tx=0x7f6384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.236 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.234+0000 7f638affd700 1 -- 172.21.15.190:0/2114565927 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6384011e30 con 0x7f638c05baa0 2020-04-02T23:48:51.237 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f63840032b0 tx=0x7f6384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.237 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f6390847700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f63840032b0 tx=0x7f6384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f638affd700 1 -- 172.21.15.190:0/2114565927 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400a160 con 0x7f638c05baa0 2020-04-02T23:48:51.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f638affd700 1 -- 172.21.15.190:0/2114565927 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638400a540 con 0x7f638c05baa0 2020-04-02T23:48:51.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f63922aa700 1 -- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 msgr2=0x7f638c13cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.238 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.235+0000 7f63922aa700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f63840032b0 tx=0x7f6384007dc0).stop 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 -- 172.21.15.190:0/2114565927 shutdown_connections 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05baa0 0x7f638c13cd90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 --2- 172.21.15.190:0/2114565927 >> v2:172.21.15.78:3300/0 conn(0x7f638c05cf70 0x7f638c0a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 --2- 172.21.15.190:0/2114565927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c0a7f50 0x7f638c05b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 -- 172.21.15.190:0/2114565927 >> 172.21.15.190:0/2114565927 conn(0x7f638c062260 msgr2=0x7f638c05c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:51.241 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 -- 172.21.15.190:0/2114565927 shutdown_connections 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.236+0000 7f63922aa700 1 -- 172.21.15.190:0/2114565927 wait complete. 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.237+0000 7f63922aa700 1 Processor -- start 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.237+0000 7f63922aa700 1 -- start start 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c05baa0 0x7f638c0a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05cf70 0x7f638c0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f638c0a7f50 0x7f638c0a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.242 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0a2520 con 0x7f638c0a7f50 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0a2280 con 0x7f638c05cf70 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f63922aa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0a0590 con 0x7f638c05baa0 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f638b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05cf70 0x7f638c0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f638b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f638c05cf70 0x7f638c0a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:32842/0 (socket says 172.21.15.190:32842) 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f638bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c05baa0 0x7f638c0a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f638b7fe700 1 -- 172.21.15.190:0/4284229028 learned_addr learned my addr 172.21.15.190:0/4284229028 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:51.243 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.238+0000 7f6390847700 1 --2- 172.21.15.190:0/4284229028 >> v2:172.21.15.78:3300/0 conn(0x7f638c0a7f50 0x7f638c0a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.244 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.242+0000 7f638b7fe700 1 -- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c05baa0 msgr2=0x7f638c0a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.244 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.242+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c05baa0 0x7f638c0a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.244 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.242+0000 7f638b7fe700 1 -- 172.21.15.190:0/4284229028 >> v2:172.21.15.78:3300/0 conn(0x7f638c0a7f50 msgr2=0x7f638c0a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.245 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.242+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> v2:172.21.15.78:3300/0 conn(0x7f638c0a7f50 0x7f638c0a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.245 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.242+0000 7f638b7fe700 1 -- 172.21.15.190:0/4284229028 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0ad3f0 con 0x7f638c05cf70 2020-04-02T23:48:51.245 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.243+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> v2:172.21.15.190:3300/0 conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.246 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.244+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> v2:172.21.15.190:3300/0 conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.246 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.244+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:51.250 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6380007340 con 0x7f638c05cf70 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63800074e0 con 0x7f638c05cf70 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63800058b0 con 0x7f638c05cf70 2020-04-02T23:48:51.251 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0ac0e0 con 0x7f638c05cf70 2020-04-02T23:48:51.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.248+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0ad1c0 con 0x7f638c05cf70 2020-04-02T23:48:51.252 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.249+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c056ec0 con 0x7f638c05cf70 2020-04-02T23:48:51.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.435+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.435+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.435+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6380005a10 con 0x7f638c05cf70 2020-04-02T23:48:51.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.435+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f63897fa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f638000d0c0 con 0x7f638c05cf70 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f63800610a0 con 0x7f638c05cf70 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f638bfff700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f638bfff700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f637c002f30 tx=0x7f637c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f638bfff700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f637c002f30 tx=0x7f637c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.436+0000 7f638bfff700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f637c002f30 tx=0x7f637c00d8b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:51.582 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.580+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f638c0a0760 con 0x7f638c05cf70 2020-04-02T23:48:51.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.584+0000 7f638b7fe700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.586 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.584+0000 7f63897fa700 1 -- 172.21.15.190:0/4284229028 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7f638003c6c0 con 0x7f638c05cf70 2020-04-02T23:48:51.586 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 1 2020-04-02T23:48:51.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 msgr2=0x7f636c04fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f637c002f30 tx=0x7f637c00d8b0).stop 2020-04-02T23:48:51.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 msgr2=0x7f638c0a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f6380002f30 tx=0x7f6380010c10).stop 2020-04-02T23:48:51.588 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 shutdown_connections 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f636c04d650 0x7f636c04fb60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> v2:172.21.15.78:3300/0 conn(0x7f638c0a7f50 0x7f638c0a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f638c05baa0 0x7f638c0a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.585+0000 7f63922aa700 1 --2- 172.21.15.190:0/4284229028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f638c05cf70 0x7f638c0a0a30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.586+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 >> 172.21.15.190:0/4284229028 conn(0x7f638c062260 msgr2=0x7f638c0a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:51.589 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.586+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 shutdown_connections 2020-04-02T23:48:51.590 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.586+0000 7f63922aa700 1 -- 172.21.15.190:0/4284229028 wait complete. 2020-04-02T23:48:51.598 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:51.611 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:48:51.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 Processor -- start 2020-04-02T23:48:51.760 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 -- start start 2020-04-02T23:48:51.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efcb40a73d0 0x7efcb40a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:51.761 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcb409f780 0x7efcb40a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:51.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb40a2c20 con 0x7efcb4136390 2020-04-02T23:48:51.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40a4b90 con 0x7efcb409f780 2020-04-02T23:48:51.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.758+0000 7efcb8c19700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40a2e50 con 0x7efcb40a73d0 2020-04-02T23:48:51.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.759+0000 7efcb1d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcb409f780 0x7efcb40a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.762 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.759+0000 7efcb259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efcb40a73d0 0x7efcb40a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.763 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.759+0000 7efcb1d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcb409f780 0x7efcb40a32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:32848/0 (socket says 172.21.15.190:32848) 2020-04-02T23:48:51.763 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.759+0000 7efcb1d9b700 1 -- 172.21.15.190:0/1972909639 learned_addr learned my addr 172.21.15.190:0/1972909639 (peer_addr_for_me v2:172.21.15.190:0/0) 2020-04-02T23:48:51.764 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb1d9b700 1 -- 172.21.15.190:0/1972909639 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efcb40a73d0 msgr2=0x7efcb40a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:51.764 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efcb40a73d0 0x7efcb40a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.765 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb1d9b700 1 -- 172.21.15.190:0/1972909639 >> v1:172.21.15.78:6789/0 conn(0x7efcb4136390 legacy=0x7efcb41367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.765 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb159a700 1 -- 172.21.15.190:0/1972909639 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539895890 0 0) 0x7efcb40a2c20 con 0x7efcb4136390 2020-04-02T23:48:51.765 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb1d9b700 1 -- 172.21.15.190:0/1972909639 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40a47c0 con 0x7efcb409f780 2020-04-02T23:48:51.765 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.762+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> v2:172.21.15.190:3300/0 conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efca8002f30 tx=0x7efca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.766 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.764+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> v2:172.21.15.190:3300/0 conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efca8002f30 tx=0x7efca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.766 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.764+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7efca8002f30 tx=0x7efca8007a40).ready entity=mon.1 client_cookie=ae6bae03852f195 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:51.770 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7efca8002f30 tx=0x7efca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7efca8002f30 tx=0x7efca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb159a700 1 -- 172.21.15.190:0/1972909639 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca8011670 con 0x7efcb409f780 2020-04-02T23:48:51.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb1d9b700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7efca8002f30 tx=0x7efca8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb159a700 1 -- 172.21.15.190:0/1972909639 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80117d0 con 0x7efcb409f780 2020-04-02T23:48:51.771 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb159a700 1 -- 172.21.15.190:0/1972909639 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca8011bb0 con 0x7efcb409f780 2020-04-02T23:48:51.772 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb8c19700 1 -- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 msgr2=0x7efcb40a32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.772 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.768+0000 7efcb8c19700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7efca8002f30 tx=0x7efca8007a40).stop 2020-04-02T23:48:51.773 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 -- 172.21.15.190:0/1972909639 shutdown_connections 2020-04-02T23:48:51.773 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efcb40a73d0 0x7efcb40a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 --2- 172.21.15.190:0/1972909639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb409f780 0x7efcb40a32f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 -- 172.21.15.190:0/1972909639 >> 172.21.15.190:0/1972909639 conn(0x7efcb405b3d0 msgr2=0x7efcb405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 -- 172.21.15.190:0/1972909639 shutdown_connections 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.769+0000 7efcb8c19700 1 -- 172.21.15.190:0/1972909639 wait complete. 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.770+0000 7efcb8c19700 1 Processor -- start 2020-04-02T23:48:51.774 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.770+0000 7efcb8c19700 1 -- start start 2020-04-02T23:48:51.775 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb8c19700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcb4136390 0x7efcb412d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.775 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb8c19700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb4136150 con 0x7efcb40a73d0 2020-04-02T23:48:51.775 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb8c19700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb409bea0 con 0x7efcb409f780 2020-04-02T23:48:51.775 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb8c19700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb409bcb0 con 0x7efcb4136390 2020-04-02T23:48:51.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb1d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efcb40a73d0 0x7efcb4135a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36708/0 (socket says 172.21.15.190:36708) 2020-04-02T23:48:51.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb1d9b700 1 -- 172.21.15.190:0/3993905524 learned_addr learned my addr 172.21.15.190:0/3993905524 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:51.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.771+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> v2:172.21.15.190:3300/0 conn(0x7efcb4136390 0x7efcb412d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.776 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.774+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201864060 0 0) 0x7efcb4136150 con 0x7efcb40a73d0 2020-04-02T23:48:51.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.774+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc90002fe0 con 0x7efcb40a73d0 2020-04-02T23:48:51.777 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.775+0000 7efcb2d9d700 1 -- 172.21.15.190:0/3993905524 >> v1:172.21.15.190:6789/0 conn(0x7efcb409f780 legacy=0x7efcb4134ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.775+0000 7efcb2d9d700 1 -- 172.21.15.190:0/3993905524 >> v1:172.21.15.78:6789/0 conn(0x7efcb40a73d0 legacy=0x7efcb4135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:51.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.775+0000 7efcb2d9d700 1 -- 172.21.15.190:0/3993905524 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb409c140 con 0x7efcb4136390 2020-04-02T23:48:51.778 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.776+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> v2:172.21.15.190:3300/0 conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.779+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> v2:172.21.15.190:3300/0 conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.781 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.779+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:51.783 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.781+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.781+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcac006bc0 con 0x7efcb4136390 2020-04-02T23:48:51.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.781+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb409c3e0 con 0x7efcb4136390 2020-04-02T23:48:51.784 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.781+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40a1150 con 0x7efcb4136390 2020-04-02T23:48:51.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.782+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.782+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.782+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac006d60 con 0x7efcb4136390 2020-04-02T23:48:51.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.782+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcac00a470 con 0x7efcb4136390 2020-04-02T23:48:51.785 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.783+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4056ec0 con 0x7efcb4136390 2020-04-02T23:48:51.975 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.973+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efcac00a5d0 con 0x7efcb4136390 2020-04-02T23:48:51.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.977 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efca37fe700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efcac060eb0 con 0x7efcb4136390 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.974+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7efcac061230 con 0x7efcb4136390 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.975+0000 7efcb259c700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.975+0000 7efcb259c700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efcb409c030 tx=0x7efca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.975+0000 7efcb259c700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efcb409c030 tx=0x7efca4007a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:51.978 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:51.975+0000 7efcb259c700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7efcb409c030 tx=0x7efca4007a80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.117 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.115+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efcb40a1150 con 0x7efcb4136390 2020-04-02T23:48:52.121 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.119+0000 7efcb2d9d700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.121 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.119+0000 7efca37fe700 1 -- 172.21.15.190:0/3993905524 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcb40a1150 con 0x7efcb4136390 2020-04-02T23:48:52.121 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:52.123 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 msgr2=0x7efc9004fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.123 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7efcb409c030 tx=0x7efca4007a80).stop 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 msgr2=0x7efcb412d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7efcac000e90 tx=0x7efcac010850).stop 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 shutdown_connections 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7efc9004d8c0 0x7efc9004fdd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 --2- 172.21.15.190:0/3993905524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4136390 0x7efcb412d100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 >> 172.21.15.190:0/3993905524 conn(0x7efcb405b3d0 msgr2=0x7efcb4130520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:52.124 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 shutdown_connections 2020-04-02T23:48:52.125 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.121+0000 7efcb8c19700 1 -- 172.21.15.190:0/3993905524 wait complete. 2020-04-02T23:48:52.134 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:52.147 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:48:52.295 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 Processor -- start 2020-04-02T23:48:52.295 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 -- start start 2020-04-02T23:48:52.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f433413ecd0 0x7f43341410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:52.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340a2c20 con 0x7f433409f780 2020-04-02T23:48:52.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340a4b90 con 0x7f43340a73d0 2020-04-02T23:48:52.296 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.293+0000 7f433a049700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43340a2e50 con 0x7f433413ecd0 2020-04-02T23:48:52.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.294+0000 7f4332ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f433409f780 0x7f43340a32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36714/0 (socket says 172.21.15.190:36714) 2020-04-02T23:48:52.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.294+0000 7f4332ffd700 1 -- 172.21.15.190:0/2765961686 learned_addr learned my addr 172.21.15.190:0/2765961686 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:52.297 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.294+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> v2:172.21.15.190:3300/0 conn(0x7f433413ecd0 0x7f43341410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.297+0000 7f43327fc700 1 -- 172.21.15.190:0/2765961686 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431839783 0 0) 0x7f43340a2c20 con 0x7f433409f780 2020-04-02T23:48:52.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.297+0000 7f43327fc700 1 -- 172.21.15.190:0/2765961686 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4320003230 con 0x7f433409f780 2020-04-02T23:48:52.299 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.297+0000 7f4333fff700 1 -- 172.21.15.190:0/2765961686 >> v1:172.21.15.190:6789/0 conn(0x7f43340a73d0 legacy=0x7f43340a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.297+0000 7f4333fff700 1 -- 172.21.15.190:0/2765961686 >> v1:172.21.15.78:6789/0 conn(0x7f433409f780 legacy=0x7f43340a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.297+0000 7f4333fff700 1 -- 172.21.15.190:0/2765961686 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334143570 con 0x7f433413ecd0 2020-04-02T23:48:52.300 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.299+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> v2:172.21.15.190:3300/0 conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f432c0032b0 tx=0x7f432c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.303 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.301+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> v2:172.21.15.190:3300/0 conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f432c0032b0 tx=0x7f432c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.303 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.301+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f432c0032b0 tx=0x7f432c007dc0).ready entity=mon.1 client_cookie=d913c2c4dc648b1a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.307 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f432c0032b0 tx=0x7f432c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.307 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f432c0032b0 tx=0x7f432c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.307 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f43327fc700 1 -- 172.21.15.190:0/2765961686 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432c011e20 con 0x7f433413ecd0 2020-04-02T23:48:52.308 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f4333fff700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f432c0032b0 tx=0x7f432c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.308 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f43327fc700 1 -- 172.21.15.190:0/2765961686 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00a160 con 0x7f433413ecd0 2020-04-02T23:48:52.308 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f43327fc700 1 -- 172.21.15.190:0/2765961686 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432c00a500 con 0x7f433413ecd0 2020-04-02T23:48:52.308 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f433a049700 1 -- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 msgr2=0x7f43341410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.308 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f433a049700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f432c0032b0 tx=0x7f432c007dc0).stop 2020-04-02T23:48:52.310 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f433a049700 1 -- 172.21.15.190:0/2765961686 shutdown_connections 2020-04-02T23:48:52.310 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f433a049700 1 --2- 172.21.15.190:0/2765961686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f433413ecd0 0x7f43341410f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.310 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.305+0000 7f433a049700 1 -- 172.21.15.190:0/2765961686 >> 172.21.15.190:0/2765961686 conn(0x7f433405b3d0 msgr2=0x7f433405b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:52.310 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.306+0000 7f433a049700 1 -- 172.21.15.190:0/2765961686 shutdown_connections 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.306+0000 7f433a049700 1 -- 172.21.15.190:0/2765961686 wait complete. 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.306+0000 7f433a049700 1 Processor -- start 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 -- start start 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 0x7f433413b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:52.311 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4334138d00 con 0x7f433413ecd0 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433413c260 con 0x7f433409f780 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.307+0000 7f433a049700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433413e9f0 con 0x7f43340a73d0 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.308+0000 7f4333fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f433413ecd0 0x7f43341396a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54320/0 (socket says 172.21.15.190:54320) 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.308+0000 7f43337fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 0x7f433413b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.308+0000 7f4333fff700 1 -- 172.21.15.190:0/2948697141 learned_addr learned my addr 172.21.15.190:0/2948697141 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:52.312 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.308+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.312+0000 7f4332ffd700 1 -- 172.21.15.190:0/2948697141 >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 msgr2=0x7f433413b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.313+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 0x7f433413b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.313+0000 7f4332ffd700 1 -- 172.21.15.190:0/2948697141 >> v1:172.21.15.190:6789/0 conn(0x7f433413ecd0 legacy=0x7f43341396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.313+0000 7f4332ffd700 1 -- 172.21.15.190:0/2948697141 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334138f60 con 0x7f43340a73d0 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.313+0000 7f43337fe700 1 --2- 172.21.15.190:0/2948697141 >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 0x7f433413b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:48:52.315 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.313+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.315+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.317 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.315+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.317+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.317+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4324005cc0 con 0x7f43340a73d0 2020-04-02T23:48:52.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.317+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334139260 con 0x7f43340a73d0 2020-04-02T23:48:52.320 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.317+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334139db0 con 0x7f43340a73d0 2020-04-02T23:48:52.322 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.318+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334056ec0 con 0x7f43340a73d0 2020-04-02T23:48:52.322 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.319+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.322 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.319+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.319+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324005e20 con 0x7f43340a73d0 2020-04-02T23:48:52.323 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.319+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432400a510 con 0x7f43340a73d0 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.509+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.510+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f432400a670 con 0x7f43340a73d0 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.510+0000 7f4330ff9700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.510+0000 7f43337fe700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.510+0000 7f43337fe700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43340a4d20 tx=0x7f43280013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.515 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.510+0000 7f43337fe700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43340a4d20 tx=0x7f43280013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.511+0000 7f43337fe700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f43340a4d20 tx=0x7f43280013a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.512+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.516 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.512+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4324040180 con 0x7f43340a73d0 2020-04-02T23:48:52.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.520+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.522 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.520+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f432403c520 con 0x7f43340a73d0 2020-04-02T23:48:52.679 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.677+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4334143350 con 0x7f43340a73d0 2020-04-02T23:48:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.682+0000 7f4332ffd700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.682+0000 7f4330ff9700 1 -- 172.21.15.190:0/2948697141 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+10 (secure 0 0 0) 0x7f432403fb40 con 0x7f43340a73d0 2020-04-02T23:48:52.684 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 msgr2=0x7f431404fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f43340a4d20 tx=0x7f43280013a0).stop 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 msgr2=0x7f433413be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f43240010d0 tx=0x7f43240108d0).stop 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 shutdown_connections 2020-04-02T23:48:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f431404d680 0x7f431404fb90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 --2- 172.21.15.190:0/2948697141 >> v2:172.21.15.190:3300/0 conn(0x7f433409f780 0x7f433413b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 --2- 172.21.15.190:0/2948697141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43340a73d0 0x7f433413be00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.683+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 >> 172.21.15.190:0/2948697141 conn(0x7f433405b3d0 msgr2=0x7f43340a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.684+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 shutdown_connections 2020-04-02T23:48:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.684+0000 7f433a049700 1 -- 172.21.15.190:0/2948697141 wait complete. 2020-04-02T23:48:52.696 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:52.709 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:48:52.859 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.857+0000 7fa31ca30700 1 Processor -- start 2020-04-02T23:48:52.859 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.857+0000 7fa31ca30700 1 -- start start 2020-04-02T23:48:52.860 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa31ca30700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:52.860 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa31ca30700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318133c30 con 0x7fa31809f0d0 2020-04-02T23:48:52.860 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa31ca30700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31813cae0 con 0x7fa31809e720 2020-04-02T23:48:52.860 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa31ca30700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31813cd80 con 0x7fa3180aa930 2020-04-02T23:48:52.861 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa315d9b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa31809e720 0x7fa3181399b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54328/0 (socket says 172.21.15.190:54328) 2020-04-02T23:48:52.861 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.858+0000 7fa315d9b700 1 -- 172.21.15.190:0/1059870585 learned_addr learned my addr 172.21.15.190:0/1059870585 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:52.861 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.859+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.863 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.861+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448489635 0 0) 0x7fa31813cae0 con 0x7fa31809e720 2020-04-02T23:48:52.863 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.861+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003230 con 0x7fa31809e720 2020-04-02T23:48:52.864 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484165775 0 0) 0x7fa3080010d0 con 0x7fa31809f0d0 2020-04-02T23:48:52.864 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31813cae0 con 0x7fa31809f0d0 2020-04-02T23:48:52.864 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31659c700 1 -- 172.21.15.190:0/1059870585 >> v1:172.21.15.190:6789/0 conn(0x7fa31809e720 legacy=0x7fa3181399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.865 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31659c700 1 -- 172.21.15.190:0/1059870585 >> v1:172.21.15.78:6789/0 conn(0x7fa31809f0d0 legacy=0x7fa31809f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.865 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31659c700 1 -- 172.21.15.190:0/1059870585 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31813d020 con 0x7fa3180aa930 2020-04-02T23:48:52.865 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.862+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.866 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.864+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.866 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.864+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).ready entity=mon.2 client_cookie=9a943947882a8f45 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa310011d70 con 0x7fa3180aa930 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31659c700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31000a160 con 0x7fa3180aa930 2020-04-02T23:48:52.871 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31559a700 1 -- 172.21.15.190:0/1059870585 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31000a4c0 con 0x7fa3180aa930 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31ca30700 1 -- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 msgr2=0x7fa31813d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.868+0000 7fa31ca30700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).stop 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.869+0000 7fa31ca30700 1 -- 172.21.15.190:0/1059870585 shutdown_connections 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.869+0000 7fa31ca30700 1 --2- 172.21.15.190:0/1059870585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa3180aa930 0x7fa31813d4c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.869+0000 7fa31ca30700 1 -- 172.21.15.190:0/1059870585 >> 172.21.15.190:0/1059870585 conn(0x7fa31805eff0 msgr2=0x7fa31805f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.869+0000 7fa31ca30700 1 -- 172.21.15.190:0/1059870585 shutdown_connections 2020-04-02T23:48:52.872 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.869+0000 7fa31ca30700 1 -- 172.21.15.190:0/1059870585 wait complete. 2020-04-02T23:48:52.873 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 Processor -- start 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 -- start start 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa3180aa930 0x7fa31814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3181311f0 con 0x7fa31809f0d0 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318131490 con 0x7fa31809e720 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.870+0000 7fa31ca30700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31812b390 con 0x7fa3180aa930 2020-04-02T23:48:52.874 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.871+0000 7fa315d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa31809f0d0 0x7fa31812ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36734/0 (socket says 172.21.15.190:36734) 2020-04-02T23:48:52.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.871+0000 7fa315d9b700 1 -- 172.21.15.190:0/757530682 learned_addr learned my addr 172.21.15.190:0/757530682 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:52.875 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.871+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> v2:172.21.15.190:3300/0 conn(0x7fa3180aa930 0x7fa31814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.874+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919548584 0 0) 0x7fa3181311f0 con 0x7fa31809f0d0 2020-04-02T23:48:52.876 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.874+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2fc002fe0 con 0x7fa31809f0d0 2020-04-02T23:48:52.877 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.875+0000 7fa316d9d700 1 -- 172.21.15.190:0/757530682 >> v1:172.21.15.190:6789/0 conn(0x7fa31809e720 legacy=0x7fa3181366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.877 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.875+0000 7fa316d9d700 1 -- 172.21.15.190:0/757530682 >> v1:172.21.15.78:6789/0 conn(0x7fa31809f0d0 legacy=0x7fa31812ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:52.877 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.875+0000 7fa316d9d700 1 -- 172.21.15.190:0/757530682 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31812b4d0 con 0x7fa3180aa930 2020-04-02T23:48:52.878 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.875+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> v2:172.21.15.190:3300/0 conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.880 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.878+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> v2:172.21.15.190:3300/0 conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.880 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.878+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa308011ea0 con 0x7fa3180aa930 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30800cc20 con 0x7fa3180aa930 2020-04-02T23:48:52.886 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.883+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa318130dc0 con 0x7fa3180aa930 2020-04-02T23:48:52.887 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.884+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30800e160 con 0x7fa3180aa930 2020-04-02T23:48:52.887 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.884+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31813be70 con 0x7fa3180aa930 2020-04-02T23:48:52.887 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.885+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318056ec0 con 0x7fa3180aa930 2020-04-02T23:48:52.900 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.898+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.901 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.898+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa3080064e0 con 0x7fa3180aa930 2020-04-02T23:48:52.901 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.899+0000 7fa30f7fe700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:52.901 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.899+0000 7fa31659c700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:52.902 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.899+0000 7fa31659c700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.902 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.899+0000 7fa31659c700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.902 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.899+0000 7fa31659c700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:52.903 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.901+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:52.903 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:52.901+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa30803fe70 con 0x7fa3180aa930 2020-04-02T23:48:53.079 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.077+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.080 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.077+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa30803c210 con 0x7fa3180aa930 2020-04-02T23:48:53.218 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.216+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa318133c30 con 0x7fa3180aa930 2020-04-02T23:48:53.226 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.224+0000 7fa316d9d700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.226 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.224+0000 7fa30f7fe700 1 -- 172.21.15.190:0/757530682 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa318133c30 con 0x7fa3180aa930 2020-04-02T23:48:53.226 INFO:teuthology.orchestra.run.smithi190.stdout:pg_num: 8 2020-04-02T23:48:53.228 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 msgr2=0x7fa2fc04fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.228 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fa3100032b0 tx=0x7fa31805afd0).stop 2020-04-02T23:48:53.228 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 msgr2=0x7fa31814a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.228 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fa3180ad990 tx=0x7fa308001180).stop 2020-04-02T23:48:53.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 shutdown_connections 2020-04-02T23:48:53.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7fa2fc04d910 0x7fa2fc04fe20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 --2- 172.21.15.190:0/757530682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3180aa930 0x7fa31814a4c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 >> 172.21.15.190:0/757530682 conn(0x7fa31805eff0 msgr2=0x7fa31806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:53.229 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 shutdown_connections 2020-04-02T23:48:53.230 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.225+0000 7fa31ca30700 1 -- 172.21.15.190:0/757530682 wait complete. 2020-04-02T23:48:53.238 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-02T23:48:53.238 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:53.252 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:48:53.397 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.395+0000 7f462c72d700 1 Processor -- start 2020-04-02T23:48:53.398 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.395+0000 7f462c72d700 1 -- start start 2020-04-02T23:48:53.399 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.396+0000 7f462c72d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:53.399 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.396+0000 7f462c72d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46241398f0 0x7f46240a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:48:53.399 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.396+0000 7f462c72d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46240a8d30 con 0x7f46240a3770 2020-04-02T23:48:53.399 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.396+0000 7f462c72d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462413a830 con 0x7f46241398f0 2020-04-02T23:48:53.399 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.396+0000 7f462c72d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46240a44c0 con 0x7f46240ad340 2020-04-02T23:48:53.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.397+0000 7f462acca700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f46240a3770 0x7f46240a3b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:54346/0 (socket says 172.21.15.190:54346) 2020-04-02T23:48:53.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.397+0000 7f462acca700 1 -- 172.21.15.190:0/3008696242 learned_addr learned my addr 172.21.15.190:0/3008696242 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:53.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.397+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> v2:172.21.15.78:3300/0 conn(0x7f46241398f0 0x7f46240a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:53.400 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.397+0000 7f462a4c9700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:53.407 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.399+0000 7f46294c7700 1 -- 172.21.15.190:0/3008696242 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237565756 0 0) 0x7f46240a8d30 con 0x7f46240a3770 2020-04-02T23:48:53.408 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.399+0000 7f46294c7700 1 -- 172.21.15.190:0/3008696242 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f460c003230 con 0x7f46240a3770 2020-04-02T23:48:53.408 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.400+0000 7f4629cc8700 1 -- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 msgr2=0x7f46240a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:48:53.408 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.400+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:53.408 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.400+0000 7f4629cc8700 1 -- 172.21.15.190:0/3008696242 >> v1:172.21.15.190:6789/0 conn(0x7f46240a3770 legacy=0x7f46240a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.408 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.400+0000 7f4629cc8700 1 -- 172.21.15.190:0/3008696242 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240a4760 con 0x7f46241398f0 2020-04-02T23:48:53.409 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.401+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> v2:172.21.15.78:3300/0 conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4614002f30 tx=0x7f4614007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.409 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.403+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> v2:172.21.15.78:3300/0 conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4614002f30 tx=0x7f4614007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.409 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.403+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f4614002f30 tx=0x7f4614007a40).ready entity=mon.0 client_cookie=48dbd12e8b969446 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:53.410 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f4614002f30 tx=0x7f4614007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.410 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f4614002f30 tx=0x7f4614007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f4629cc8700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f4614002f30 tx=0x7f4614007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f46294c7700 1 -- 172.21.15.190:0/3008696242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4614011310 con 0x7f46241398f0 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f46294c7700 1 -- 172.21.15.190:0/3008696242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614011470 con 0x7f46241398f0 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f46294c7700 1 -- 172.21.15.190:0/3008696242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4614011890 con 0x7f46241398f0 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f462c72d700 1 -- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 msgr2=0x7f46240a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.411 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.407+0000 7f462c72d700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f4614002f30 tx=0x7f4614007a40).stop 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 -- 172.21.15.190:0/3008696242 shutdown_connections 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 --2- 172.21.15.190:0/3008696242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46241398f0 0x7f46240a8490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 -- 172.21.15.190:0/3008696242 >> 172.21.15.190:0/3008696242 conn(0x7f4624062380 msgr2=0x7f46240ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 -- 172.21.15.190:0/3008696242 shutdown_connections 2020-04-02T23:48:53.412 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.408+0000 7f462c72d700 1 -- 172.21.15.190:0/3008696242 wait complete. 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.409+0000 7f462c72d700 1 Processor -- start 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.409+0000 7f462c72d700 1 -- start start 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462c72d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462c72d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46241398f0 0x7f4624135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462c72d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4624135ea0 con 0x7f46240a3770 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462c72d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4624135060 con 0x7f46241398f0 2020-04-02T23:48:53.414 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462c72d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4624135300 con 0x7f46240ad340 2020-04-02T23:48:53.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462acca700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46241398f0 0x7f4624135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:53.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462a4c9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f46240a3770 0x7f46240a0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.190:36748/0 (socket says 172.21.15.190:36748) 2020-04-02T23:48:53.415 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f462a4c9700 1 -- 172.21.15.190:0/646337553 learned_addr learned my addr 172.21.15.190:0/646337553 (peer_addr_for_me v1:172.21.15.190:0/0) 2020-04-02T23:48:53.416 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.410+0000 7f4629cc8700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.413+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913170803 0 0) 0x7f4624135ea0 con 0x7f46240a3770 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.413+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4604002fe0 con 0x7f46240a3770 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.414+0000 7f462acca700 1 -- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 msgr2=0x7f46240a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.414+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.414+0000 7f462acca700 1 -- 172.21.15.190:0/646337553 >> v1:172.21.15.78:6789/0 conn(0x7f46240a3770 legacy=0x7f46240a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.417 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.414+0000 7f462acca700 1 -- 172.21.15.190:0/646337553 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46241355a0 con 0x7f46241398f0 2020-04-02T23:48:53.418 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.415+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> v2:172.21.15.190:3300/0 conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.418 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.416+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> v2:172.21.15.190:3300/0 conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.418 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.416+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:53.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.423 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.424 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4620005cc0 con 0x7f46241398f0 2020-04-02T23:48:53.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620005e20 con 0x7f46241398f0 2020-04-02T23:48:53.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46240a1590 con 0x7f46241398f0 2020-04-02T23:48:53.425 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46200062b0 con 0x7f46241398f0 2020-04-02T23:48:53.426 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.421+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46240a1a30 con 0x7f46241398f0 2020-04-02T23:48:53.426 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.422+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624056ec0 con 0x7f46241398f0 2020-04-02T23:48:53.437 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.435+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.436+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f46200064e0 con 0x7f46241398f0 2020-04-02T23:48:53.438 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.436+0000 7f46137fe700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:48:53.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.436+0000 7f462a4c9700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:48:53.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.437+0000 7f462a4c9700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f461c008360 tx=0x7f461c009430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.437+0000 7f462a4c9700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f461c008360 tx=0x7f461c009430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.439 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.437+0000 7f462a4c9700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f461c008360 tx=0x7f461c009430).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:48:53.614 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.612+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.614 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.612+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f46200403f0 con 0x7f46241398f0 2020-04-02T23:48:53.614 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.612+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.615 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.612+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f462003c730 con 0x7f46241398f0 2020-04-02T23:48:53.812 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.810+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4624069c30 con 0x7f46241398f0 2020-04-02T23:48:53.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.834+0000 7f462acca700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:48:53.837 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.834+0000 7f46137fe700 1 -- 172.21.15.190:0/646337553 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f462003fd50 con 0x7f46241398f0 2020-04-02T23:48:53.838 INFO:teuthology.orchestra.run.smithi190.stdout: 2020-04-02T23:48:53.838 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.78:6835/368243036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":368243036},{"type":"v1","addr":"172.21.15.78:6835","nonce":368243036}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:48:28.761290+0000","modified":"2020-04-02T23:48:46.650056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4429":{"gid":4429,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6833/1548843936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":1548843936},{"type":"v1","addr":"172.21.15.190:6833","nonce":1548843936}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:48:53.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 msgr2=0x7f460404fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f461c008360 tx=0x7f461c009430).stop 2020-04-02T23:48:53.839 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 msgr2=0x7f4624135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f46240a2f30 tx=0x7f4620010850).stop 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 shutdown_connections 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:6800/24250,v1:172.21.15.78:6801/24250] conn(0x7f460404d920 0x7f460404fe30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46241398f0 0x7f4624135a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 --2- 172.21.15.190:0/646337553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46240ad340 0x7f46240a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 >> 172.21.15.190:0/646337553 conn(0x7f4624062380 msgr2=0x7f46240ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:48:53.840 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 shutdown_connections 2020-04-02T23:48:53.841 INFO:teuthology.orchestra.run.smithi190.stderr:2020-04-02T23:48:53.836+0000 7f462c72d700 1 -- 172.21.15.190:0/646337553 wait complete. 2020-04-02T23:48:53.841 INFO:teuthology.orchestra.run.smithi190.stderr:dumped fsmap epoch 6 2020-04-02T23:48:54.050 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4429}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4429': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4429, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1548843936, u'type': u'v2', u'addr': u'172.21.15.190:6832'}, {u'nonce': 1548843936, u'type': u'v1', u'addr': u'172.21.15.190:6833'}]}, u'addr': u'172.21.15.190:6833/1548843936'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:48:28.761290+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:48:46.650056+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:48:54.050 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:48:54.051 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.064 INFO:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:48:54.245 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2020-04-02T23:48:54.245 INFO:teuthology.orchestra.run.smithi190.stdout: "cluster_fsid": "01f4b530-6799-492e-8606-c311ffa25289", 2020-04-02T23:48:54.245 INFO:teuthology.orchestra.run.smithi190.stdout: "whoami": 0, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4429, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "want_state": "up:active", 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "state": "up:active", 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "rank_uptime": 10.536311297999999, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "mdsmap_epoch": 6, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_epoch": 27, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_epoch_barrier": 27, 2020-04-02T23:48:54.246 INFO:teuthology.orchestra.run.smithi190.stdout: "uptime": 15.775305947 2020-04-02T23:48:54.247 INFO:teuthology.orchestra.run.smithi190.stdout:} 2020-04-02T23:48:54.254 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "01f4b530-6799-492e-8606-c311ffa25289", "whoami": 0, "id": 4429, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.536311297999999, "mdsmap_epoch": 6, "osdmap_epoch": 27, "osdmap_epoch_barrier": 27, "uptime": 15.775305947 } 2020-04-02T23:48:54.255 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-02T23:48:54.255 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2020-04-02T23:48:54.255 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi190.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-02T23:48:54.255 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:54.269 INFO:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:48:54.328 DEBUG:teuthology.misc:running client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2020-04-02T23:48:54.328 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:54.376 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:54.445 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:54.450 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:54.451 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:54.499 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:48:54.553 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:48:54.559 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:48:54.559 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-02T23:48:54.559 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.610 INFO:teuthology.orchestra.run.smithi190:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-04-02T23:48:54.653 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:54.666 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:54.743 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:54.745 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:54.745 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:54.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:54.799 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:48:54.853 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:48:54.858 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:48:55.959 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:55.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:55.973 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:56.043 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:56.052 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:56.053 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:56.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:56.097 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:48:56.152 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:48:56.156 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:48:57.257 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:57.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:57.271 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:57.339 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:57.346 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:57.347 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:57.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:57.393 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:48:57.446 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:48:57.452 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:48:58.554 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:58.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:58.570 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:58.637 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:58.643 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:58.643 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:58.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:58.691 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:48:58.745 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:48:58.750 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:48:59.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi190.stderr:ceph-fuse[28884]: starting ceph client 2020-04-02T23:48:59.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi190.stderr:2020-04-02T23:48:59.656+0000 4041400 -1 init, newargv = 0x12b48200 newargc=7 2020-04-02T23:48:59.852 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:59.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:59.867 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:48:59.942 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:48:59.944 INFO:teuthology.orchestra.run.smithi190.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:48:59.944 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:48:59.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:48:59.997 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:49:00.053 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:49:00.057 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:49:00.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi190.stderr:ceph-fuse[28884]: starting fuse 2020-04-02T23:49:01.160 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.175 INFO:teuthology.orchestra.run.smithi190:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:49:01.250 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.297 INFO:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2020-04-02T23:49:01.356 INFO:teuthology.orchestra.run.smithi190.stdout:47 2020-04-02T23:49:01.356 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-02T23:49:01.356 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> sudo python3 -c ' 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> import glob 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> import re 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> import os 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> import subprocess 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> def find_socket(client_name): 2020-04-02T23:49:01.404 INFO:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2020-04-02T23:49:01.405 INFO:teuthology.orchestra.run.smithi190:> return files[0] 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> for f in files: 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> return f 2020-04-02T23:49:01.410 INFO:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-02T23:49:01.411 INFO:teuthology.orchestra.run.smithi190:> 2020-04-02T23:49:01.411 INFO:teuthology.orchestra.run.smithi190:> print(find_socket("client.0")) 2020-04-02T23:49:01.411 INFO:teuthology.orchestra.run.smithi190:> ' 2020-04-02T23:49:01.430 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:49:01.444 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:01.491 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.506 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:01.512 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.0.28884.asok 2020-04-02T23:49:01.512 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28884.asok 2020-04-02T23:49:01.512 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.562 INFO:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28884.asok status 2020-04-02T23:49:01.821 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2020-04-02T23:49:01.821 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2020-04-02T23:49:01.821 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "cbb84f71d70460f911296715ab61ac09c6962b17", 2020-04-02T23:49:01.821 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 16.0.0-316-gcbb84f7 (cbb84f71d70460f911296715ab61ac09c6962b17) octopus (rc)", 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "0", 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "28884", 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2020-04-02T23:49:01.822 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4579, 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4579 2020-04-02T23:49:01.823 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "172.21.15.190:0", 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2122383868 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: } 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2020-04-02T23:49:01.824 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "172.21.15.190:0", 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2122383868 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4579 172.21.15.190:0/2122383868", 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "172.21.15.190:0/2122383868", 2020-04-02T23:49:01.825 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 6, 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 27, 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190.stdout: "blacklisted": false 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190.stdout:} 2020-04-02T23:49:01.826 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.840 INFO:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:49:01.841 INFO:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:49:01.949 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2020-04-02T23:49:01.949 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:49:01.949 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:01.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:49:01.977 INFO:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:49:02.186 INFO:teuthology.run_tasks:Running task workunit... 2020-04-02T23:49:02.201 INFO:tasks.workunit:Pulling workunits from ref cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:49:02.201 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-02T23:49:02.201 INFO:tasks.workunit:timeout=3h 2020-04-02T23:49:02.202 INFO:tasks.workunit:cleanup=True 2020-04-02T23:49:02.202 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:02.215 INFO:teuthology.orchestra.run.smithi190:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-02T23:49:02.297 INFO:teuthology.orchestra.run.smithi190.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 2fh/47d Inode: 1 Links: 2 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:fusefs_t:s0 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2020-04-02 23:48:44.051289599 +0000 2020-04-02T23:49:02.298 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2020-04-02 23:49:02.055081403 +0000 2020-04-02T23:49:02.299 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2020-04-02T23:49:02.299 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-04-02T23:49:02.299 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:02.351 INFO:teuthology.orchestra.run.smithi190:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-04-02T23:49:02.872 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:02.889 INFO:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:49:02.993 INFO:tasks.workunit.client.0.smithi190.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-02T23:49:31.606 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:49:31.620 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:31.662 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:31.678 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:49:38.688 INFO:tasks.workunit.client.0.smithi190.stderr:Note: checking out 'cbb84f71d70460f911296715ab61ac09c6962b17'. 2020-04-02T23:49:38.688 INFO:tasks.workunit.client.0.smithi190.stderr: 2020-04-02T23:49:38.688 INFO:tasks.workunit.client.0.smithi190.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-02T23:49:38.688 INFO:tasks.workunit.client.0.smithi190.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-02T23:49:38.689 INFO:tasks.workunit.client.0.smithi190.stderr:state without impacting any branches by performing another checkout. 2020-04-02T23:49:38.689 INFO:tasks.workunit.client.0.smithi190.stderr: 2020-04-02T23:49:38.689 INFO:tasks.workunit.client.0.smithi190.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-02T23:49:38.689 INFO:tasks.workunit.client.0.smithi190.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-02T23:49:38.690 INFO:tasks.workunit.client.0.smithi190.stderr: 2020-04-02T23:49:38.690 INFO:tasks.workunit.client.0.smithi190.stderr: git checkout -b 2020-04-02T23:49:38.690 INFO:tasks.workunit.client.0.smithi190.stderr: 2020-04-02T23:49:38.690 INFO:tasks.workunit.client.0.smithi190.stderr:HEAD is now at cbb84f71d7 Merge branch 'fs-qa-vstart_runner.LocalRemote.sh' of https://github.com/rishabh-d-dave/ceph into wip-greg-testing-42 2020-04-02T23:49:38.692 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:38.706 INFO:teuthology.orchestra.run.smithi190:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-02T23:49:38.774 INFO:tasks.workunit.client.0.smithi190.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-02T23:49:38.776 INFO:tasks.workunit.client.0.smithi190.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:49:38.776 INFO:tasks.workunit.client.0.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-02T23:49:39.430 INFO:tasks.workunit.client.0.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-02T23:49:39.477 INFO:tasks.workunit.client.0.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-02T23:49:39.514 INFO:tasks.workunit.client.0.smithi190.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:49:39.516 INFO:tasks.workunit.client.0.smithi190.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:49:39.516 INFO:tasks.workunit.client.0.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-02T23:49:39.555 INFO:tasks.workunit.client.0.smithi190.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:49:39.612 DEBUG:teuthology.orchestra.remote:smithi190:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-02T23:49:39.659 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2020-04-02T23:49:39.659 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2020-04-02T23:49:39.660 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:49:39.690 INFO:teuthology.orchestra.run.smithi190:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2020-04-02T23:49:40.196 INFO:tasks.workunit.client.0.smithi190.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-04-02T23:49:40.196 INFO:tasks.workunit.client.0.smithi190.stdout: 2020-04-02T23:49:40.196 INFO:tasks.workunit.client.0.smithi190.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-04-02T23:49:40.206 INFO:tasks.workunit.client.0.smithi190.stdout:0 of 1 processes prepared for launch 0 sec 2020-04-02T23:49:40.307 INFO:tasks.workunit.client.0.smithi190.stdout:1 of 1 processes prepared for launch 0 sec 2020-04-02T23:49:40.307 INFO:tasks.workunit.client.0.smithi190.stdout:releasing clients 2020-04-02T23:49:41.307 INFO:tasks.workunit.client.0.smithi190.stdout: 0 12 0.00 MB/sec warmup 1 sec latency 341.486 ms 2020-04-02T23:49:42.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 39 0.69 MB/sec warmup 2 sec latency 231.596 ms 2020-04-02T23:49:43.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 58 0.79 MB/sec warmup 3 sec latency 547.889 ms 2020-04-02T23:49:44.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 85 0.97 MB/sec warmup 4 sec latency 202.899 ms 2020-04-02T23:49:45.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 113 1.05 MB/sec warmup 5 sec latency 171.257 ms 2020-04-02T23:49:46.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 137 1.00 MB/sec warmup 6 sec latency 268.493 ms 2020-04-02T23:49:47.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 165 0.97 MB/sec warmup 7 sec latency 255.360 ms 2020-04-02T23:49:48.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 184 0.92 MB/sec warmup 8 sec latency 259.858 ms 2020-04-02T23:49:49.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 207 0.90 MB/sec warmup 9 sec latency 246.899 ms 2020-04-02T23:49:50.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 228 0.88 MB/sec warmup 10 sec latency 327.565 ms 2020-04-02T23:49:51.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 247 0.85 MB/sec warmup 11 sec latency 255.509 ms 2020-04-02T23:49:52.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 271 0.85 MB/sec warmup 12 sec latency 297.378 ms 2020-04-02T23:49:53.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 295 0.84 MB/sec warmup 13 sec latency 275.623 ms 2020-04-02T23:49:54.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 318 0.82 MB/sec warmup 14 sec latency 228.293 ms 2020-04-02T23:49:55.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 341 0.82 MB/sec warmup 15 sec latency 245.162 ms 2020-04-02T23:49:56.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 365 0.82 MB/sec warmup 16 sec latency 302.507 ms 2020-04-02T23:49:57.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 389 0.81 MB/sec warmup 17 sec latency 230.035 ms 2020-04-02T23:49:58.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 408 0.80 MB/sec warmup 18 sec latency 270.751 ms 2020-04-02T23:49:59.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 429 0.80 MB/sec warmup 19 sec latency 330.176 ms 2020-04-02T23:50:00.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 448 0.78 MB/sec warmup 20 sec latency 318.942 ms 2020-04-02T23:50:01.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 469 0.78 MB/sec warmup 21 sec latency 298.031 ms 2020-04-02T23:50:01.780 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:50:01.795 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:01.837 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:50:01.852 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:02.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 490 0.78 MB/sec warmup 22 sec latency 318.978 ms 2020-04-02T23:50:03.307 INFO:tasks.workunit.client.0.smithi190.stdout: 1 511 0.77 MB/sec warmup 23 sec latency 339.356 ms 2020-04-02T23:50:04.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 535 0.78 MB/sec warmup 24 sec latency 322.504 ms 2020-04-02T23:50:05.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 590 0.81 MB/sec warmup 25 sec latency 247.745 ms 2020-04-02T23:50:06.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 649 0.81 MB/sec warmup 26 sec latency 113.452 ms 2020-04-02T23:50:07.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 666 0.78 MB/sec warmup 27 sec latency 269.339 ms 2020-04-02T23:50:08.315 INFO:tasks.workunit.client.0.smithi190.stdout: 1 689 0.76 MB/sec warmup 28 sec latency 216.456 ms 2020-04-02T23:50:09.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 712 0.73 MB/sec warmup 29 sec latency 313.988 ms 2020-04-02T23:50:10.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 742 0.71 MB/sec warmup 30 sec latency 139.274 ms 2020-04-02T23:50:11.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 778 0.69 MB/sec warmup 31 sec latency 251.139 ms 2020-04-02T23:50:12.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 801 0.67 MB/sec warmup 32 sec latency 292.905 ms 2020-04-02T23:50:13.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 854 0.65 MB/sec warmup 33 sec latency 170.611 ms 2020-04-02T23:50:14.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 876 0.64 MB/sec warmup 34 sec latency 250.755 ms 2020-04-02T23:50:15.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 902 0.62 MB/sec warmup 35 sec latency 271.979 ms 2020-04-02T23:50:16.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 931 0.60 MB/sec warmup 36 sec latency 280.724 ms 2020-04-02T23:50:17.312 INFO:tasks.workunit.client.0.smithi190.stdout: 1 969 0.59 MB/sec warmup 37 sec latency 222.797 ms 2020-04-02T23:50:18.314 INFO:tasks.workunit.client.0.smithi190.stdout: 1 998 0.58 MB/sec warmup 38 sec latency 291.061 ms 2020-04-02T23:50:19.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1041 0.59 MB/sec warmup 39 sec latency 120.441 ms 2020-04-02T23:50:20.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1064 0.57 MB/sec warmup 40 sec latency 297.957 ms 2020-04-02T23:50:21.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1114 0.56 MB/sec warmup 41 sec latency 213.529 ms 2020-04-02T23:50:22.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1148 0.55 MB/sec warmup 42 sec latency 247.092 ms 2020-04-02T23:50:23.311 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1177 0.54 MB/sec warmup 43 sec latency 146.360 ms 2020-04-02T23:50:24.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1214 0.52 MB/sec warmup 44 sec latency 155.898 ms 2020-04-02T23:50:25.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1244 0.51 MB/sec warmup 45 sec latency 218.432 ms 2020-04-02T23:50:26.308 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1281 0.50 MB/sec warmup 46 sec latency 277.851 ms 2020-04-02T23:50:27.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1394 0.55 MB/sec warmup 47 sec latency 153.136 ms 2020-04-02T23:50:28.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1428 0.54 MB/sec warmup 48 sec latency 215.407 ms 2020-04-02T23:50:29.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1464 0.53 MB/sec warmup 49 sec latency 205.057 ms 2020-04-02T23:50:30.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1499 0.52 MB/sec warmup 50 sec latency 155.736 ms 2020-04-02T23:50:31.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1523 0.51 MB/sec warmup 51 sec latency 224.614 ms 2020-04-02T23:50:31.950 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:50:31.963 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:32.005 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:50:32.020 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:50:32.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1560 0.50 MB/sec warmup 52 sec latency 247.286 ms 2020-04-02T23:50:33.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1591 0.49 MB/sec warmup 53 sec latency 121.672 ms 2020-04-02T23:50:34.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1632 0.48 MB/sec warmup 54 sec latency 202.958 ms 2020-04-02T23:50:35.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1653 0.48 MB/sec warmup 55 sec latency 293.731 ms 2020-04-02T23:50:36.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1686 0.47 MB/sec warmup 56 sec latency 279.688 ms 2020-04-02T23:50:37.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1721 0.46 MB/sec warmup 57 sec latency 308.507 ms 2020-04-02T23:50:38.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1773 0.45 MB/sec warmup 58 sec latency 315.625 ms 2020-04-02T23:50:39.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1820 0.45 MB/sec warmup 59 sec latency 172.698 ms 2020-04-02T23:50:40.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1855 0.44 MB/sec warmup 60 sec latency 205.983 ms 2020-04-02T23:50:41.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1888 0.43 MB/sec warmup 61 sec latency 212.542 ms 2020-04-02T23:50:42.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1954 0.43 MB/sec warmup 62 sec latency 127.475 ms 2020-04-02T23:50:43.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 1992 0.42 MB/sec warmup 63 sec latency 296.149 ms 2020-04-02T23:50:44.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2054 0.42 MB/sec warmup 64 sec latency 49.704 ms 2020-04-02T23:50:45.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2095 0.41 MB/sec warmup 65 sec latency 153.107 ms 2020-04-02T23:50:46.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2150 0.40 MB/sec warmup 66 sec latency 274.820 ms 2020-04-02T23:50:47.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2198 0.40 MB/sec warmup 67 sec latency 121.100 ms 2020-04-02T23:50:48.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2258 0.39 MB/sec warmup 68 sec latency 253.031 ms 2020-04-02T23:50:49.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2297 0.40 MB/sec warmup 69 sec latency 167.549 ms 2020-04-02T23:50:50.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2339 0.40 MB/sec warmup 70 sec latency 231.442 ms 2020-04-02T23:50:51.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2367 0.39 MB/sec warmup 71 sec latency 257.901 ms 2020-04-02T23:50:52.309 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2391 0.39 MB/sec warmup 72 sec latency 279.063 ms 2020-04-02T23:50:53.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2407 0.38 MB/sec warmup 73 sec latency 181.218 ms 2020-04-02T23:50:54.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2429 0.38 MB/sec warmup 74 sec latency 452.031 ms 2020-04-02T23:50:55.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2438 0.37 MB/sec warmup 75 sec latency 524.370 ms 2020-04-02T23:50:56.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2454 0.37 MB/sec warmup 76 sec latency 192.428 ms 2020-04-02T23:50:57.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2487 0.37 MB/sec warmup 77 sec latency 151.475 ms 2020-04-02T23:50:58.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2554 0.37 MB/sec warmup 78 sec latency 269.002 ms 2020-04-02T23:50:59.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2576 0.37 MB/sec warmup 79 sec latency 172.791 ms 2020-04-02T23:51:00.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2596 0.36 MB/sec warmup 80 sec latency 192.788 ms 2020-04-02T23:51:01.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2608 0.36 MB/sec warmup 81 sec latency 317.248 ms 2020-04-02T23:51:02.128 INFO:teuthology.orchestra.run.smithi078:> true 2020-04-02T23:51:02.142 INFO:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:51:02.184 INFO:teuthology.orchestra.run.smithi190:> true 2020-04-02T23:51:02.198 INFO:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:51:02.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2752 0.39 MB/sec warmup 82 sec latency 182.180 ms 2020-04-02T23:51:03.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2779 0.39 MB/sec warmup 83 sec latency 195.907 ms 2020-04-02T23:51:04.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2883 0.38 MB/sec warmup 84 sec latency 182.066 ms 2020-04-02T23:51:05.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2903 0.39 MB/sec warmup 85 sec latency 221.083 ms 2020-04-02T23:51:06.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2931 0.39 MB/sec warmup 86 sec latency 215.011 ms 2020-04-02T23:51:07.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2974 0.39 MB/sec warmup 87 sec latency 275.830 ms 2020-04-02T23:51:08.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 2993 0.38 MB/sec warmup 88 sec latency 201.159 ms 2020-04-02T23:51:09.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3017 0.38 MB/sec warmup 89 sec latency 267.363 ms 2020-04-02T23:51:10.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3171 0.38 MB/sec warmup 90 sec latency 176.710 ms 2020-04-02T23:51:11.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3199 0.38 MB/sec warmup 91 sec latency 181.072 ms 2020-04-02T23:51:12.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3246 0.38 MB/sec warmup 92 sec latency 255.250 ms 2020-04-02T23:51:13.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3287 0.38 MB/sec warmup 93 sec latency 121.338 ms 2020-04-02T23:51:14.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3315 0.38 MB/sec warmup 94 sec latency 172.702 ms 2020-04-02T23:51:15.310 INFO:tasks.workunit.client.0.smithi190.stdout: 1 3337 0.37 MB/sec warmup 95 sec latency 216.665 ms 2020-04-02T23:51:15.797 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-02T23:51:15.798 DEBUG:teuthology.task.console_log:Killing console logger for smithi190 2020-04-02T23:51:15.799 DEBUG:teuthology.task.console_log:Killing console logger for smithi078 2020-04-02T23:51:15.800 DEBUG:teuthology.task.console_log:Killing console logger for smithi190 2020-04-02T23:51:15.800 DEBUG:teuthology.task.console_log:Killing console logger for smithi078 2020-04-02T23:51:15.801 DEBUG:teuthology.exit:Finished running handlers